Jul 08 14:20:15 devstack cinder-volume[75685]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 14:20:15 devstack cinder-volume[75685]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 14:20:15 devstack cinder-volume[75685]: we strongly recommend against using it for new projects. Jul 08 14:20:15 devstack cinder-volume[75685]: If you are already using Eventlet, we recommend migrating to a different Jul 08 14:20:15 devstack cinder-volume[75685]: framework. For more detail see Jul 08 14:20:15 devstack cinder-volume[75685]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 14:20:15 devstack cinder-volume[75685]: import eventlet # noqa Jul 08 14:20:18 devstack cinder-volume[75685]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75685) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 14:20:18 devstack cinder-volume[75685]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75685) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 14:20:18 devstack cinder-volume[75685]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75685) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 14:20:19 devstack cinder-volume[75685]: INFO dbcounter [None req-77adb036-af71-42e7-a024-c34358641069 None None] Registered counter for database cinder Jul 08 14:20:19 devstack cinder-volume[75685]: DEBUG oslo_db.sqlalchemy.engines [None req-77adb036-af71-42e7-a024-c34358641069 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75685) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:20:19 devstack cinder-volume[75685]: DEBUG dbcounter [-] [75685] Writer thread running {{(pid=75685) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 14:20:19 devstack cinder-volume[75685]: INFO cinder.rpc [None req-77adb036-af71-42e7-a024-c34358641069 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 14:20:19 devstack cinder-volume[75685]: INFO cinder.rpc [None req-77adb036-af71-42e7-a024-c34358641069 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 14:20:19 devstack cinder-volume[75685]: DEBUG oslo_db.sqlalchemy.engines [None req-77adb036-af71-42e7-a024-c34358641069 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75685) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:20:19 devstack cinder-volume[75685]: INFO cinder.volume.manager [None req-77adb036-af71-42e7-a024-c34358641069 None None] Determined volume DB was empty at startup. Jul 08 14:20:19 devstack cinder-volume[75685]: DEBUG cinder.volume.manager [None req-77adb036-af71-42e7-a024-c34358641069 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75685) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 14:20:19 devstack cinder-volume[75685]: INFO cinder.volume.manager [None req-77adb036-af71-42e7-a024-c34358641069 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 14:20:19 devstack cinder-volume[75685]: WARNING stevedore.named [None req-77adb036-af71-42e7-a024-c34358641069 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 14:20:19 devstack cinder-volume[75685]: WARNING castellan.key_manager [None req-77adb036-af71-42e7-a024-c34358641069 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 14:20:19 devstack cinder-volume[75685]: WARNING cinder.keymgr.conf_key_mgr [None req-77adb036-af71-42e7-a024-c34358641069 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 14:20:19 devstack cinder-volume[75685]: DEBUG cinder.volume.drivers.lvm [None req-77adb036-af71-42e7-a024-c34358641069 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75685) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 08 14:20:19 devstack cinder-volume[75685]: DEBUG oslo_concurrency.processutils [None req-77adb036-af71-42e7-a024-c34358641069 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75685) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_concurrency.processutils [None req-77adb036-af71-42e7-a024-c34358641069 None None] CMD "cinder-rtstool verify" returned: 0 in 0.420s {{(pid=75685) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_db.sqlalchemy.engines [None req-77adb036-af71-42e7-a024-c34358641069 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75685) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:20:20 devstack cinder-volume[75685]: INFO cinder.rpc [None req-77adb036-af71-42e7-a024-c34358641069 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 08 14:20:20 devstack cinder-volume[75685]: INFO cinder.rpc [None req-77adb036-af71-42e7-a024-c34358641069 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 08 14:20:20 devstack cinder-volume[75685]: WARNING stevedore.named [None req-77adb036-af71-42e7-a024-c34358641069 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 14:20:20 devstack cinder-volume[75685]: WARNING castellan.key_manager [None req-77adb036-af71-42e7-a024-c34358641069 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 14:20:20 devstack cinder-volume[75685]: INFO cinder.volume.manager [None req-77adb036-af71-42e7-a024-c34358641069 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_db.sqlalchemy.engines [None req-77adb036-af71-42e7-a024-c34358641069 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75685) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:20:20 devstack cinder-volume[75685]: INFO oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] Starting 1 workers Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] Started child 75848 {{(pid=75685) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] Full set of CONF: {{(pid=75685) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] ******************************************************************************** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] Configuration options gathered from: {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] ================================================================================ {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] allow_availability_zone_fallback = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] allow_compression_on_image_upload = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] allowed_direct_url_schemes = [] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] api_rate_limit = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] auth_strategy = keystone {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75848]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] az_cache_duration = 3600 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_availability_zone = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_host = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_name = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_stats_polling_interval = 60 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backup_api_class = cinder.backup.api.API {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backup_name_template = backup-%s {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backup_use_same_host = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backup_use_temp_snapshot = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] chap_password = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] chap_username = {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cinder_internal_tenant_project_id = 2abed3d1a93f4a1a8847b2d7e1fdd559 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cinder_internal_tenant_user_id = 3c048ee8ec034f4f8f176f92c0ac99aa {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cloned_volume_same_az = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cluster = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] compression_format = gzip {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] compute_api_class = cinder.compute.nova.API {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] config_dir = [] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] config_source = [] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] control_exchange = openstack {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] debug = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] default_availability_zone = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] default_group_type = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] default_volume_type = lvmdriver-1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] disk_geometry = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] driver_client_cert = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] driver_client_cert_key = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] driver_data_namespace = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] driver_ssl_cert_path = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] driver_ssl_cert_verify = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] driver_use_ssl = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] enable_force_upload = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] enable_new_services = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] enable_unsupported_driver = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] enforce_multipath_for_image_xfer = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] filter_function = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] glance_api_insecure = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75848]: INFO cinder.volume.manager [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 08 14:20:20 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] glance_api_servers = ['http://192.168.122.74/image'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] glance_api_ssl_compression = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] glance_ca_certificates_file = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] glance_catalog_info = image:glance:publicURL {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] glance_certfile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] glance_keyfile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] glance_num_retries = 3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] glance_request_timeout = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] goodness_function = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] graceful_shutdown_timeout = 5 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] group_api_class = cinder.group.api.API {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] host = devstack {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] image_compress_on_upload = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] image_conversion_address_space_limit = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] image_conversion_cpu_limit = 60 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] image_conversion_disable = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] image_upload_use_cinder_backend = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] image_upload_use_internal_tenant = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] image_volume_cache_enabled = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] image_volume_cache_max_count = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] image_volume_cache_max_size_gb = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] init_host_max_objects_retrieval = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] instance_format = [instance: %(uuid)s] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] iscsi_target_flags = {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] iscsi_write_cache = on {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] iser_helper = tgtadm {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] iser_ip_address = 192.168.122.74 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] iser_port = 3260 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] log_color = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] log_config_append = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] log_dir = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] log_file = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] log_options = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] log_rotate_interval = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] log_rotate_interval_type = days {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] log_rotation_type = none {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] max_age = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] max_logfile_count = 30 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] max_logfile_size_mb = 200 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] max_over_subscription_ratio = 20.0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] message_reap_interval = 86400 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] message_ttl = 2592000 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] migration_create_volume_timeout_secs = 300 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] monkey_patch = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] monkey_patch_modules = [] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] my_ip = 192.168.122.74 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] no_snapshot_gb_quota = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] num_iser_scan_tries = 3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] num_shell_tries = 3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] num_volume_device_scan_tries = 3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] nvmeof_conn_info_version = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] nvmet_ns_id = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] nvmet_port_id = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] osapi_max_limit = 1000 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] osapi_volume_ext_list = [] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] osapi_volume_listen_port = 8776 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] osapi_volume_use_ssl = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] osapi_volume_workers = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] per_volume_size_limit = -1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] periodic_fuzzy_delay = 60 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] periodic_interval = 60 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] public_endpoint = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] publish_errors = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] quota_backup_gigabytes = 1000 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] quota_backups = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] quota_gigabytes = 1000 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] quota_groups = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] quota_snapshots = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] quota_volumes = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] rate_limit_burst = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] rate_limit_except_level = CRITICAL {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] rate_limit_interval = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] reinit_driver_count = 3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] replication_device = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] report_discard_supported = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] report_interval = 120 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] reservation_clean_interval = 86400 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] reservation_expire = 86400 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] reserved_image_namespaces = [] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] reserved_percentage = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] rpc_response_timeout = 120 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] run_external_periodic_tasks = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] scst_target_driver = iscsi {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] scst_target_iqn_name = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] service_down_time = 720 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] shell_completion = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] snapshot_name_template = snapshot-%s {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] snapshot_same_host = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] split_loggers = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] state_path = /opt/stack/data/cinder {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] storage_availability_zone = nova {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] storage_protocol = iSCSI {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] syslog_log_facility = LOG_USER {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] target_helper = lioadm {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] target_ip_address = 192.168.122.74 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] target_port = 3260 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] target_protocol = iscsi {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] target_secondary_ip_addresses = [] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] trace_flags = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] transport_url = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] until_refresh = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] use_chap_auth = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] use_default_quota_class = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] use_journal = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] use_json = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] use_multipath_for_image_xfer = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] use_stderr = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] use_syslog = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] verify_glance_signatures = enabled {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] volume_api_class = cinder.volume.api.API {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] volume_backend_name = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] volume_clear = zero {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] volume_clear_ionice = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] volume_clear_size = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] volume_copy_bps_limit = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] volume_dd_blocksize = 1M {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] volume_name_template = volume-%s {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] volume_service_inithost_offload = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] volume_usage_audit_period = month {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] zoning_mode = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_concurrency.disable_process_locking = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.auth_section = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.auth_type = password {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.auth_version = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.cache = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.certfile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.include_service_catalog = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.insecure = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.interface = public {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.keyfile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.memcache_password = {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.memcache_username = {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.region_name = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.service_type = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.74/identity {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.backend = dogpile.cache.null {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.backend_argument = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.backend_expiration_time = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.config_prefix = cache.oslo {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.debug_cache_backend = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.enable_retry_client = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.enable_socket_keepalive = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.enabled = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.expiration_time = 600 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack sudo[75852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.hashclient_retry_attempts = 2 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.memcache_dead_retry = 300 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.memcache_pool_maxsize = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack sudo[75852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.memcache_sasl_enabled = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.password = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.proxies = [] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.redis_db = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.redis_server = localhost:6379 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.retry_attempts = 2 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.retry_delay = 0.0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.socket_keepalive_count = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.socket_keepalive_idle = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.socket_keepalive_interval = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.socket_timeout = 1.0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.tls_allowed_ciphers = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.tls_cafile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.tls_certfile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.tls_enabled = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.tls_keyfile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cache.username = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] coordination.backend_url = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] database.asyncio_connection = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] database.asyncio_slave_connection = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] database.backend = sqlalchemy {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] database.connection = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] database.connection_debug = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] database.connection_parameters = {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] database.connection_recycle_time = 3600 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] database.connection_trace = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] database.db_inc_retry_interval = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] database.db_max_retries = 20 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] database.db_max_retry_interval = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] database.db_retry_interval = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] database.max_overflow = 50 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] database.max_pool_size = 5 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] database.max_retries = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] database.mysql_wsrep_sync_wait = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] database.pool_timeout = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] database.retry_interval = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] database.slave_connection = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] database.sqlite_synchronous = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] database.synchronous_reader = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] database.use_db_reconnect = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] profiler.connection_string = messaging:// {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] profiler.enabled = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] profiler.es_doc_type = notification {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] profiler.es_scroll_size = 10000 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] profiler.es_scroll_time = 2m {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] profiler.filter_error_trace = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] profiler.hmac_keys = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] profiler.sentinel_service_name = mymaster {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] profiler.socket_timeout = 0.1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] profiler.trace_requests = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] profiler.trace_sqlalchemy = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] profiler_jaeger.process_tags = {} {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] profiler_jaeger.service_name_prefix = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] profiler_otlp.service_name_prefix = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_policy.enforce_new_defaults = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_policy.enforce_scope = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_policy.policy_default_rule = default {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_policy.policy_file = policy.yaml {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] privsep_osbrick.group = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] privsep_osbrick.helper_command = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] privsep_osbrick.user = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cinder_sys_admin.group = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cinder_sys_admin.helper_command = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] cinder_sys_admin.user = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] service_user.auth_section = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] service_user.auth_type = password {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] service_user.cafile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] service_user.certfile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] service_user.collect_timing = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] service_user.insecure = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] service_user.keyfile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] service_user.send_service_user_token = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] service_user.split_loggers = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] service_user.timeout = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] glance.auth_section = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] glance.auth_type = password {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] glance.certfile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] glance.collect_timing = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] glance.insecure = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] glance.keyfile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] glance.region_name = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] glance.split_loggers = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] glance.timeout = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.backend_availability_zone = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.chap_password = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.chap_username = {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.disk_geometry = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.driver_client_cert = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.driver_client_cert_key = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.driver_data_namespace = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.driver_use_ssl = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.extra_capabilities = {} {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.filter_function = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.goodness_function = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.iscsi_target_flags = {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.iscsi_write_cache = on {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.iser_helper = tgtadm {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.iser_ip_address = 192.168.122.74 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.iser_port = 3260 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.lvm_share_target = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.lvm_type = auto {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.num_shell_tries = 3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.replication_device = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.report_discard_supported = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.reserved_percentage = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.target_helper = tgtadm {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.target_ip_address = 192.168.122.74 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.target_port = 3260 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.target_protocol = iscsi {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.trace_flags = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.unique_fqdn_network = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.use_chap_auth = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.volume_backend_name = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.volume_clear = zero {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.volume_clear_ionice = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.volume_clear_size = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_reports.file_event_handler = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_reports.log_dir = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.backend_host = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.chap_password = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.chap_username = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.disk_geometry = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.driver_client_cert = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.extra_capabilities = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.filter_function = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.goodness_function = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.iser_helper = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.iser_ip_address = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.iser_port = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.lvm_share_target = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.lvm_type = auto {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.num_shell_tries = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.replication_device = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.report_discard_supported = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.reserved_percentage = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.scst_target_driver = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.storage_protocol = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.target_helper = lioadm {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.target_ip_address = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.target_port = 3260 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.trace_flags = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.use_chap_auth = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.volume_clear = zero {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.volume_clear_size = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] lvmdriver-1.volumes_dir = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.ssl = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_notifications.driver = [] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_notifications.retry = -1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] key_manager.fixed_key = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican.barbican_api_version = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican.barbican_endpoint = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican.barbican_endpoint_type = public {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican.barbican_region_name = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican.cafile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican.certfile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican.collect_timing = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican.insecure = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican.keyfile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican.number_of_retries = 60 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican.retry_delay = 1 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican.send_service_user_token = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican.split_loggers = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican.timeout = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican.verify_ssl = True {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican.verify_ssl_path = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican_service_user.auth_section = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican_service_user.auth_type = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican_service_user.cafile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican_service_user.certfile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican_service_user.collect_timing = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican_service_user.insecure = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican_service_user.keyfile = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican_service_user.split_loggers = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] barbican_service_user.timeout = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] vault.approle_role_id = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] vault.approle_secret_id = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] vault.kv_mountpoint = secret {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] vault.kv_path = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] vault.kv_version = 2 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] vault.namespace = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] vault.root_token_id = **** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] vault.ssl_ca_crt_file = None {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] vault.timeout = 60.0 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] vault.use_ssl = False {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:20:20 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] ******************************************************************************** {{(pid=75685) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 14:20:21 devstack sudo[75852]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:21 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.766s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:21 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:21 devstack sudo[75857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:20:21 devstack sudo[75857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:21 devstack sudo[75857]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:21 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.707s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:21 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:20:21 devstack cinder-volume[75848]: INFO cinder.brick.local_dev.lvm [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 08 14:20:21 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:22 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:22 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:22 devstack sudo[76111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 14:20:22 devstack sudo[76111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:22 devstack sudo[76111]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:22 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.798s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:22 devstack cinder-volume[75848]: DEBUG cinder.brick.local_dev.lvm [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75848) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 08 14:20:22 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:22 devstack sudo[76336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:20:22 devstack sudo[76336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:24 devstack sudo[76336]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:24 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.616s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:24 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:24 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:24 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:24 devstack sudo[76626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:20:24 devstack sudo[76626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:25 devstack sudo[76626]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:25 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.861s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:25 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:25 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:25 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:25 devstack sudo[76630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 08 14:20:25 devstack sudo[76630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:26 devstack sudo[76630]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:26 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.807s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:26 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:26 devstack sudo[76634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 14:20:26 devstack sudo[76634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:27 devstack sudo[76634]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:27 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.893s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:27 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:27 devstack sudo[76644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 14:20:27 devstack sudo[76644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:27 devstack sudo[76644]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:27 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.818s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:27 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:27 devstack sudo[76654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:20:27 devstack sudo[76654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:28 devstack sudo[76654]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:28 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.831s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:28 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:28 devstack sudo[76693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:20:28 devstack sudo[76693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:29 devstack sudo[76693]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:29 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.907s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:29 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:29 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:29 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:29 devstack sudo[76699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:20:29 devstack sudo[76699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:30 devstack cinder-volume[75685]: DEBUG dbcounter [-] [75685] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75685) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:20:30 devstack sudo[76699]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:30 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.835s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:30 devstack cinder-volume[75848]: INFO cinder.volume.drivers.lvm [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 08 14:20:30 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:30 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:30 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:30 devstack sudo[76713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:20:30 devstack sudo[76713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:31 devstack sudo[76713]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:31 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.813s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:31 devstack cinder-volume[75848]: DEBUG cinder.volume.drivers.lvm [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Updating volume stats {{(pid=75848) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 14:20:31 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:31 devstack sudo[76828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 14:20:31 devstack sudo[76828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:32 devstack sudo[76828]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:32 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.783s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:32 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:32 devstack sudo[76968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:20:32 devstack sudo[76968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:32 devstack sudo[76968]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:32 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.732s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:32 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:32 devstack sudo[76972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:20:32 devstack sudo[76972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:33 devstack sudo[76972]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:33 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.720s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:33 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:33 devstack sudo[76975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:20:33 devstack sudo[76975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:34 devstack sudo[76975]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:34 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.721s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:34 devstack cinder-volume[75848]: INFO cinder.volume.driver [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Driver hasn't implemented _init_vendor_properties() Jul 08 14:20:34 devstack cinder-volume[75848]: DEBUG cinder.volume.driver [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75848) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 14:20:34 devstack cinder-volume[75848]: DEBUG oslo_db.sqlalchemy.engines [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75848) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:20:34 devstack cinder-volume[75848]: DEBUG dbcounter [-] [75848] Writer thread running {{(pid=75848) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 14:20:34 devstack cinder-volume[75848]: DEBUG cinder.db.api [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Building query based on filter {{(pid=75848) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 14:20:34 devstack cinder-volume[75848]: DEBUG cinder.image.image_utils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75848) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 14:20:34 devstack cinder-volume[75848]: INFO cinder.keymgr.migration [None req-341f28eb-5e57-4adb-9625-ea76eaf91631 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 14:20:34 devstack cinder-volume[75848]: DEBUG cinder.volume.drivers.lvm [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Updating volume stats {{(pid=75848) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 14:20:34 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:34 devstack sudo[76979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 14:20:34 devstack sudo[76979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:35 devstack sudo[76979]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:35 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.776s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:35 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:35 devstack sudo[76985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:20:35 devstack sudo[76985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:35 devstack sudo[76985]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:35 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.760s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:35 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:35 devstack sudo[76988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:20:35 devstack sudo[76988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:36 devstack sudo[76988]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:36 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.744s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:36 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:36 devstack sudo[76992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:20:36 devstack sudo[76992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:37 devstack sudo[76992]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:37 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.766s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:37 devstack cinder-volume[75848]: DEBUG cinder.manager [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Notifying Schedulers of capabilities ... {{(pid=75848) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:20:37 devstack cinder-volume[75848]: INFO cinder.volume.manager [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Driver initialization completed successfully. Jul 08 14:20:37 devstack cinder-volume[75848]: INFO cinder.manager [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Initiating service 2 cleanup Jul 08 14:20:37 devstack cinder-volume[75848]: INFO cinder.manager [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Service 2 cleanup completed. Jul 08 14:20:37 devstack cinder-volume[75848]: DEBUG cinder.service [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Creating RPC server for service cinder-volume {{(pid=75848) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 14:20:37 devstack cinder-volume[75848]: DEBUG cinder.service [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75848) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 14:20:37 devstack cinder-volume[75848]: INFO cinder.volume.manager [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 08 14:20:37 devstack cinder-volume[75848]: DEBUG cinder.volume.drivers.lvm [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Updating volume stats {{(pid=75848) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 14:20:37 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:37 devstack sudo[76996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 14:20:37 devstack sudo[76996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:38 devstack sudo[76996]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:38 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:38 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:38 devstack sudo[76999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:20:38 devstack sudo[76999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:39 devstack sudo[76999]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:39 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.680s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:39 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:39 devstack sudo[77005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:20:39 devstack sudo[77005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:39 devstack sudo[77005]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:39 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.719s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:39 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:20:39 devstack sudo[77062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:20:39 devstack sudo[77062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:20:40 devstack sudo[77062]: pam_unix(sudo:session): session closed for user root Jul 08 14:20:40 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:20:40 devstack cinder-volume[75848]: INFO cinder.volume.manager [None req-7b511ea7-d2d4-467b-82aa-1edeaeb7da1f None None] Driver post RPC initialization completed successfully. Jul 08 14:20:50 devstack cinder-volume[75848]: DEBUG dbcounter [-] [75848] Writing DB stats cinder:SELECT=3 {{(pid=75848) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:20:50 devstack cinder-volume[75848]: DEBUG dbcounter [-] [75848] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75848) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:20:56 devstack cinder-volume[75848]: DEBUG oslo_service.periodic_task [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running periodic task VolumeManager._thread_info {{(pid=75848) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:20:56 devstack cinder-volume[75848]: DEBUG cinder.volume.manager [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] thread count: 6 {{(pid=75848) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:20:56 devstack cinder-volume[75848]: DEBUG cinder.volume.manager [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] thread info: [<_MainThread(MainThread, started 138302741610624)>, , , , , ] {{(pid=75848) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:21:56 devstack cinder-volume[75848]: DEBUG oslo_service.periodic_task [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75848) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:21:56 devstack cinder-volume[75848]: DEBUG cinder.volume.drivers.lvm [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Updating volume stats {{(pid=75848) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 14:21:56 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:21:56 devstack sudo[79107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 14:21:56 devstack sudo[79107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:21:57 devstack sudo[79107]: pam_unix(sudo:session): session closed for user root Jul 08 14:21:57 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.677s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:21:57 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:21:57 devstack sudo[79126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:21:57 devstack sudo[79126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:21:57 devstack sudo[79126]: pam_unix(sudo:session): session closed for user root Jul 08 14:21:57 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.720s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:21:57 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:21:57 devstack sudo[79131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:21:57 devstack sudo[79131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:21:58 devstack sudo[79131]: pam_unix(sudo:session): session closed for user root Jul 08 14:21:58 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.721s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:21:58 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:21:58 devstack sudo[79231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:21:58 devstack sudo[79231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:21:59 devstack sudo[79231]: pam_unix(sudo:session): session closed for user root Jul 08 14:21:59 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:21:59 devstack cinder-volume[75848]: DEBUG cinder.manager [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Notifying Schedulers of capabilities ... {{(pid=75848) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:21:59 devstack cinder-volume[75848]: DEBUG oslo_service.periodic_task [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running periodic task VolumeManager._thread_info {{(pid=75848) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:21:59 devstack cinder-volume[75848]: DEBUG cinder.volume.manager [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] thread count: 6 {{(pid=75848) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:21:59 devstack cinder-volume[75848]: DEBUG cinder.volume.manager [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] thread info: [<_MainThread(MainThread, started 138302741610624)>, , , , , ] {{(pid=75848) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:22:50 devstack cinder-volume[75848]: DEBUG dbcounter [-] [75848] Writing DB stats cinder:SELECT=1 {{(pid=75848) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:22:50 devstack cinder-volume[75848]: DEBUG dbcounter [-] [75848] Writing DB stats cinder:UPDATE=1 {{(pid=75848) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:22:56 devstack cinder-volume[75848]: DEBUG oslo_service.periodic_task [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75848) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:22:56 devstack cinder-volume[75848]: DEBUG cinder.volume.drivers.lvm [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Updating volume stats {{(pid=75848) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 14:22:56 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:22:56 devstack sudo[82249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 14:22:56 devstack sudo[82249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:22:57 devstack sudo[82249]: pam_unix(sudo:session): session closed for user root Jul 08 14:22:57 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:22:57 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:22:57 devstack sudo[82293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:22:57 devstack sudo[82293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:22:57 devstack sudo[82293]: pam_unix(sudo:session): session closed for user root Jul 08 14:22:57 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.645s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:22:57 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:22:57 devstack sudo[82302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:22:57 devstack sudo[82302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:22:58 devstack sudo[82302]: pam_unix(sudo:session): session closed for user root Jul 08 14:22:58 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.646s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:22:58 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:22:58 devstack sudo[82306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:22:58 devstack sudo[82306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:22:59 devstack sudo[82306]: pam_unix(sudo:session): session closed for user root Jul 08 14:22:59 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:22:59 devstack cinder-volume[75848]: DEBUG cinder.manager [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Notifying Schedulers of capabilities ... {{(pid=75848) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:22:59 devstack cinder-volume[75848]: DEBUG oslo_service.periodic_task [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running periodic task VolumeManager._thread_info {{(pid=75848) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:22:59 devstack cinder-volume[75848]: DEBUG cinder.volume.manager [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] thread count: 6 {{(pid=75848) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:22:59 devstack cinder-volume[75848]: DEBUG cinder.volume.manager [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] thread info: [<_MainThread(MainThread, started 138302741610624)>, , , , , ] {{(pid=75848) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:23:56 devstack cinder-volume[75848]: DEBUG oslo_service.periodic_task [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75848) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:23:56 devstack cinder-volume[75848]: DEBUG cinder.volume.drivers.lvm [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Updating volume stats {{(pid=75848) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 14:23:56 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:23:56 devstack sudo[84208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 14:23:56 devstack sudo[84208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:23:57 devstack sudo[84208]: pam_unix(sudo:session): session closed for user root Jul 08 14:23:57 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.708s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:23:57 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:23:57 devstack sudo[84222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:23:57 devstack sudo[84222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:23:57 devstack sudo[84222]: pam_unix(sudo:session): session closed for user root Jul 08 14:23:57 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.746s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:23:57 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:23:57 devstack sudo[84248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:23:57 devstack sudo[84248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:23:58 devstack sudo[84248]: pam_unix(sudo:session): session closed for user root Jul 08 14:23:58 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.692s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:23:58 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:23:58 devstack sudo[84254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:23:58 devstack sudo[84254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:23:59 devstack sudo[84254]: pam_unix(sudo:session): session closed for user root Jul 08 14:23:59 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.708s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:23:59 devstack cinder-volume[75848]: DEBUG cinder.manager [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Notifying Schedulers of capabilities ... {{(pid=75848) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:23:59 devstack cinder-volume[75848]: DEBUG oslo_service.periodic_task [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running periodic task VolumeManager._thread_info {{(pid=75848) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:23:59 devstack cinder-volume[75848]: DEBUG cinder.volume.manager [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] thread count: 6 {{(pid=75848) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:23:59 devstack cinder-volume[75848]: DEBUG cinder.volume.manager [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] thread info: [<_MainThread(MainThread, started 138302741610624)>, , , , , ] {{(pid=75848) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:24:50 devstack cinder-volume[75848]: DEBUG dbcounter [-] [75848] Writing DB stats cinder:SELECT=1 {{(pid=75848) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:24:50 devstack cinder-volume[75848]: DEBUG dbcounter [-] [75848] Writing DB stats cinder:UPDATE=1 {{(pid=75848) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:24:56 devstack cinder-volume[75848]: DEBUG oslo_service.periodic_task [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75848) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:24:56 devstack cinder-volume[75848]: DEBUG cinder.volume.drivers.lvm [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Updating volume stats {{(pid=75848) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 14:24:56 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:24:56 devstack sudo[85439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 14:24:56 devstack sudo[85439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:24:57 devstack sudo[85439]: pam_unix(sudo:session): session closed for user root Jul 08 14:24:57 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.702s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:24:57 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:24:57 devstack sudo[85453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:24:57 devstack sudo[85453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:24:57 devstack sudo[85453]: pam_unix(sudo:session): session closed for user root Jul 08 14:24:57 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:24:57 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:24:57 devstack sudo[85457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 14:24:57 devstack sudo[85457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:24:58 devstack sudo[85457]: pam_unix(sudo:session): session closed for user root Jul 08 14:24:58 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.646s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:24:58 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:24:58 devstack sudo[85471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 14:24:58 devstack sudo[85471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:24:59 devstack sudo[85471]: pam_unix(sudo:session): session closed for user root Jul 08 14:24:59 devstack cinder-volume[75848]: DEBUG oslo_concurrency.processutils [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.699s {{(pid=75848) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:24:59 devstack cinder-volume[75848]: DEBUG cinder.manager [None req-a160abb8-4065-4396-94b6-5dda84fcf645 None None] Notifying Schedulers of capabilities ... {{(pid=75848) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:25:18 devstack cinder-volume[75685]: INFO oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] Caught SIGTERM, stopping children Jul 08 14:25:18 devstack cinder-volume[75685]: DEBUG oslo_concurrency.lockutils [None req-77adb036-af71-42e7-a024-c34358641069 None None] Acquiring lock "singleton_lock" {{(pid=75685) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 14:25:18 devstack cinder-volume[75685]: DEBUG oslo_concurrency.lockutils [None req-77adb036-af71-42e7-a024-c34358641069 None None] Acquired lock "singleton_lock" {{(pid=75685) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 14:25:18 devstack cinder-volume[75685]: DEBUG oslo_concurrency.lockutils [None req-77adb036-af71-42e7-a024-c34358641069 None None] Releasing lock "singleton_lock" {{(pid=75685) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 14:25:18 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] Stop services. {{(pid=75685) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 14:25:18 devstack cinder-volume[75685]: DEBUG oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] Killing children. {{(pid=75685) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 14:25:18 devstack cinder-volume[75685]: INFO oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] Waiting on 1 children to exit Jul 08 14:25:22 devstack cinder-volume[75848]: DEBUG oslo_concurrency.lockutils [None req-77adb036-af71-42e7-a024-c34358641069 None None] Acquiring lock "singleton_lock" {{(pid=75848) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 14:25:22 devstack cinder-volume[75848]: DEBUG oslo_concurrency.lockutils [None req-77adb036-af71-42e7-a024-c34358641069 None None] Acquired lock "singleton_lock" {{(pid=75848) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 14:25:22 devstack cinder-volume[75848]: DEBUG oslo_concurrency.lockutils [None req-77adb036-af71-42e7-a024-c34358641069 None None] Releasing lock "singleton_lock" {{(pid=75848) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 14:25:22 devstack cinder-volume[75848]: WARNING amqp [None req-77adb036-af71-42e7-a024-c34358641069 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 14:25:22 devstack cinder-volume[75848]: WARNING amqp [None req-77adb036-af71-42e7-a024-c34358641069 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 14:25:22 devstack cinder-volume[75685]: INFO oslo_service.backend._eventlet.service [None req-77adb036-af71-42e7-a024-c34358641069 None None] Child 75848 exited with status 0 Jul 08 14:25:23 devstack cinder-volume[86407]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 14:25:23 devstack cinder-volume[86407]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 14:25:23 devstack cinder-volume[86407]: we strongly recommend against using it for new projects. Jul 08 14:25:23 devstack cinder-volume[86407]: If you are already using Eventlet, we recommend migrating to a different Jul 08 14:25:23 devstack cinder-volume[86407]: framework. For more detail see Jul 08 14:25:23 devstack cinder-volume[86407]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 14:25:23 devstack cinder-volume[86407]: import eventlet # noqa Jul 08 14:25:25 devstack cinder-volume[86407]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86407) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 14:25:25 devstack cinder-volume[86407]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86407) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 14:25:25 devstack cinder-volume[86407]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86407) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 14:25:25 devstack cinder-volume[86407]: INFO dbcounter [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Registered counter for database cinder Jul 08 14:25:25 devstack cinder-volume[86407]: DEBUG oslo_db.sqlalchemy.engines [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86407) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG dbcounter [-] [86407] Writer thread running {{(pid=86407) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 14:25:26 devstack cinder-volume[86407]: INFO cinder.rpc [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 14:25:26 devstack cinder-volume[86407]: INFO cinder.rpc [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_db.sqlalchemy.engines [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86407) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:25:26 devstack cinder-volume[86407]: INFO cinder.volume.manager [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Determined volume DB was empty at startup. Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG cinder.volume.manager [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86407) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 14:25:26 devstack cinder-volume[86407]: INFO cinder.volume.manager [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 14:25:26 devstack cinder-volume[86407]: WARNING stevedore.named [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 14:25:26 devstack cinder-volume[86407]: WARNING castellan.key_manager [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 14:25:26 devstack cinder-volume[86407]: WARNING cinder.keymgr.conf_key_mgr [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 14:25:26 devstack cinder-volume[86407]: INFO cinder.volume.manager [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_db.sqlalchemy.engines [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86407) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:25:26 devstack cinder-volume[86407]: INFO oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Starting 1 workers Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Started child 86622 {{(pid=86407) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Full set of CONF: {{(pid=86407) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] ******************************************************************************** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Configuration options gathered from: {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] ================================================================================ {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] allow_availability_zone_fallback = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] allow_compression_on_image_upload = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] allowed_direct_url_schemes = [] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] api_rate_limit = True {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] auth_strategy = keystone {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_availability_zone = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_host = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_name = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_stats_polling_interval = 60 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backup_api_class = cinder.backup.api.API {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backup_name_template = backup-%s {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86622]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backup_use_same_host = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backup_use_temp_snapshot = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] chap_password = **** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] chap_username = {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cinder_internal_tenant_project_id = 2abed3d1a93f4a1a8847b2d7e1fdd559 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cinder_internal_tenant_user_id = 3c048ee8ec034f4f8f176f92c0ac99aa {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cluster = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] compression_format = gzip {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] compute_api_class = cinder.compute.nova.API {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] config_dir = [] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] config_source = [] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] control_exchange = openstack {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] debug = True {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] default_availability_zone = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] default_group_type = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] default_volume_type = QuobyteHD {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] disk_geometry = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] driver_client_cert = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] driver_client_cert_key = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] driver_data_namespace = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] driver_ssl_cert_path = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] driver_ssl_cert_verify = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] driver_use_ssl = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] enable_new_services = True {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] enable_unsupported_driver = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] enabled_backends = ['QuobyteHD'] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] enforce_multipath_for_image_xfer = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] filter_function = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] glance_api_insecure = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] glance_api_servers = ['http://192.168.122.74/image'] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] glance_api_ssl_compression = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] glance_ca_certificates_file = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] glance_catalog_info = image:glance:publicURL {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] glance_certfile = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] glance_keyfile = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] glance_num_retries = 3 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] glance_request_timeout = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] goodness_function = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] graceful_shutdown_timeout = 5 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] group_api_class = cinder.group.api.API {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] host = devstack {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] image_compress_on_upload = True {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] image_conversion_address_space_limit = 1 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] image_conversion_cpu_limit = 60 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] image_conversion_disable = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] image_upload_use_cinder_backend = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] image_upload_use_internal_tenant = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] image_volume_cache_enabled = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] image_volume_cache_max_count = 0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] image_volume_cache_max_size_gb = 0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] init_host_max_objects_retrieval = 0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] instance_format = [instance: %(uuid)s] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] iscsi_target_flags = {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] iscsi_write_cache = on {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] iser_helper = tgtadm {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] iser_ip_address = 192.168.122.74 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] iser_port = 3260 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] log_color = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] log_config_append = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] log_dir = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] log_file = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] log_options = True {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] log_rotate_interval = 1 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] log_rotate_interval_type = days {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] log_rotation_type = none {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] max_age = 0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] max_logfile_count = 30 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] max_logfile_size_mb = 200 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] max_over_subscription_ratio = 20.0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] message_reap_interval = 86400 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] message_ttl = 2592000 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] migration_create_volume_timeout_secs = 300 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] monkey_patch = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] monkey_patch_modules = [] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86622]: INFO cinder.volume.manager [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 14:25:26 devstack cinder-volume[86622]: DEBUG cinder.volume.drivers.remotefs [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86622) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] my_ip = 192.168.122.74 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] no_snapshot_gb_quota = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] num_iser_scan_tries = 3 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] num_shell_tries = 3 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] num_volume_device_scan_tries = 3 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] nvmeof_conn_info_version = 1 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] nvmet_ns_id = 10 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] nvmet_port_id = 1 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] osapi_max_limit = 1000 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] osapi_volume_ext_list = [] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] osapi_volume_listen_port = 8776 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] osapi_volume_use_ssl = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] osapi_volume_workers = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] per_volume_size_limit = -1 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] periodic_fuzzy_delay = 60 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] periodic_interval = 60 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] public_endpoint = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] publish_errors = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] quota_backup_gigabytes = 1000 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] quota_backups = 10 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] quota_gigabytes = 1000 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] quota_groups = 10 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] quota_snapshots = 10 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] quota_volumes = 10 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] rate_limit_burst = 0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] rate_limit_except_level = CRITICAL {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] rate_limit_interval = 0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] reinit_driver_count = 3 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] replication_device = **** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] report_discard_supported = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] report_interval = 120 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] reservation_clean_interval = 86400 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] reservation_expire = 86400 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] reserved_image_namespaces = [] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] reserved_percentage = 0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] rpc_response_timeout = 120 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] run_external_periodic_tasks = True {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] scst_target_driver = iscsi {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] scst_target_iqn_name = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] service_down_time = 720 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] shell_completion = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] snapshot_name_template = snapshot-%s {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] split_loggers = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] state_path = /opt/stack/data/cinder {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] storage_availability_zone = nova {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] storage_protocol = iSCSI {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] syslog_log_facility = LOG_USER {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] target_helper = lioadm {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] target_ip_address = 192.168.122.74 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] target_port = 3260 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] target_protocol = iscsi {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] target_secondary_ip_addresses = [] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] trace_flags = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] transport_url = **** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86622]: DEBUG cinder.volume.drivers.quobyte [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86622) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 14:25:26 devstack cinder-volume[86622]: WARNING cinder.volume.drivers.quobyte [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 14:25:26 devstack cinder-volume[86622]: WARNING cinder.volume.drivers.quobyte [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 14:25:26 devstack cinder-volume[86622]: DEBUG oslo_concurrency.processutils [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Running cmd (subprocess): mount.quobyte {{(pid=86622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] until_refresh = 0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] use_chap_auth = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] use_default_quota_class = True {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] use_journal = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] use_json = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] use_multipath_for_image_xfer = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] use_stderr = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] use_syslog = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] verify_glance_signatures = enabled {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] volume_api_class = cinder.volume.api.API {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] volume_backend_name = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] volume_clear = zero {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] volume_clear_ionice = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] volume_clear_size = 0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] volume_copy_bps_limit = 0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] volume_dd_blocksize = 1M {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] volume_name_template = volume-%s {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] volume_service_inithost_offload = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] volume_usage_audit_period = month {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] zoning_mode = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_concurrency.disable_process_locking = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.auth_section = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.auth_type = password {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.auth_version = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.cache = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.certfile = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.include_service_catalog = True {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.insecure = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.interface = public {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.keyfile = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.memcache_password = {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.memcache_username = {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.region_name = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.service_type = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.74/identity {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.backend = dogpile.cache.null {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.backend_argument = **** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.backend_expiration_time = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.config_prefix = cache.oslo {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.debug_cache_backend = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.enable_retry_client = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.enable_socket_keepalive = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.enabled = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.expiration_time = 600 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.hashclient_retry_attempts = 2 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.memcache_dead_retry = 300 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.memcache_pool_maxsize = 10 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.memcache_sasl_enabled = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.password = **** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.proxies = [] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.redis_db = 0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack quobyte-client[86623]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 14:25:26 devstack quobyte-client[86623]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.redis_server = localhost:6379 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.retry_attempts = 2 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.retry_delay = 0.0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.socket_keepalive_count = 1 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.socket_keepalive_idle = 1 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.socket_keepalive_interval = 1 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.socket_timeout = 1.0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86622]: DEBUG oslo_concurrency.processutils [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] CMD "mount.quobyte" returned: 1 in 0.109s {{(pid=86622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.tls_allowed_ciphers = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.tls_cafile = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86622]: DEBUG oslo_concurrency.lockutils [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86622) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.tls_certfile = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86622]: DEBUG oslo_concurrency.lockutils [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86622) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:25:26 devstack cinder-volume[86622]: DEBUG cinder.volume.drivers.quobyte [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=86622) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:25:26 devstack cinder-volume[86622]: INFO cinder.volume.drivers.quobyte [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad ... Jul 08 14:25:26 devstack cinder-volume[86622]: DEBUG oslo_concurrency.processutils [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 -c /etc/quobyte/client-cinder.cfg {{(pid=86622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.tls_enabled = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.tls_keyfile = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cache.username = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] coordination.backend_url = **** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] database.asyncio_connection = **** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] database.asyncio_slave_connection = **** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] database.backend = sqlalchemy {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] database.connection = **** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] database.connection_debug = 0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] database.connection_parameters = {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] database.connection_recycle_time = 3600 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] database.connection_trace = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] database.db_inc_retry_interval = True {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] database.db_max_retries = 20 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] database.db_max_retry_interval = 10 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] database.db_retry_interval = 1 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] database.max_overflow = 50 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] database.max_pool_size = 5 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] database.max_retries = 10 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] database.mysql_wsrep_sync_wait = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] database.pool_timeout = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] database.retry_interval = 10 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] database.slave_connection = **** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] database.sqlite_synchronous = True {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] database.synchronous_reader = True {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] database.use_db_reconnect = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] profiler.connection_string = messaging:// {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] profiler.enabled = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] profiler.es_doc_type = notification {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] profiler.es_scroll_size = 10000 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] profiler.es_scroll_time = 2m {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] profiler.filter_error_trace = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] profiler.hmac_keys = **** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] profiler.sentinel_service_name = mymaster {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack sudo[86628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 -c /etc/quobyte/client-cinder.cfg Jul 08 14:25:26 devstack sudo[86628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] profiler.socket_timeout = 0.1 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] profiler.trace_requests = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] profiler.trace_sqlalchemy = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] profiler_jaeger.process_tags = {} {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] profiler_jaeger.service_name_prefix = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] profiler_otlp.service_name_prefix = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_policy.enforce_new_defaults = True {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_policy.enforce_scope = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_policy.policy_default_rule = default {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_policy.policy_file = policy.yaml {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] privsep_osbrick.group = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] privsep_osbrick.helper_command = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] privsep_osbrick.user = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cinder_sys_admin.group = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cinder_sys_admin.helper_command = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] cinder_sys_admin.user = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] service_user.auth_section = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] service_user.auth_type = password {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] service_user.cafile = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] service_user.certfile = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] service_user.collect_timing = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] service_user.insecure = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] service_user.keyfile = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] service_user.send_service_user_token = True {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] service_user.split_loggers = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] service_user.timeout = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] glance.auth_section = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] glance.auth_type = password {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] glance.certfile = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] glance.collect_timing = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] glance.insecure = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] glance.keyfile = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] glance.region_name = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] glance.split_loggers = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] glance.timeout = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.backend_availability_zone = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.chap_password = **** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.chap_username = {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.disk_geometry = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.driver_client_cert = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.driver_client_cert_key = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.driver_data_namespace = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.driver_use_ssl = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.extra_capabilities = {} {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.filter_function = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.goodness_function = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.iscsi_target_flags = {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.iscsi_write_cache = on {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.iser_helper = tgtadm {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.iser_ip_address = 192.168.122.74 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.iser_port = 3260 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.nas_host = {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.nas_login = admin {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.nas_mount_options = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.nas_password = **** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.nas_private_key = {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.nas_share_path = {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.num_shell_tries = 3 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.quobyte_volume_url = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.replication_device = **** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.report_discard_supported = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.reserved_percentage = 0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.target_helper = tgtadm {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.target_ip_address = 192.168.122.74 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.target_port = 3260 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.target_protocol = iscsi {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.trace_flags = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.unique_fqdn_network = True {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.use_chap_auth = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.volume_backend_name = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.volume_clear = zero {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.volume_clear_ionice = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.volume_clear_size = 0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_reports.file_event_handler = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_reports.log_dir = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.backend_availability_zone = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.backend_host = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.chap_password = **** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.chap_username = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.chiscsi_conf = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.disk_geometry = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.driver_client_cert = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:26 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.driver_data_namespace = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.driver_use_ssl = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.extra_capabilities = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.filter_function = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.goodness_function = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.iser_helper = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.iser_ip_address = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.iser_port = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.iser_target_prefix = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.nas_host = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.nas_login = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.nas_mount_options = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.nas_password = **** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.nas_private_key = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.nas_share_path = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.nas_ssh_port = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.num_shell_tries = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.nvmet_port_id = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.replication_device = **** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.report_discard_supported = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.reserved_percentage = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.scst_target_driver = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.storage_protocol = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.target_helper = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.target_ip_address = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.target_port = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.target_prefix = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.target_protocol = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.trace_flags = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.use_chap_auth = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.volume_clear = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.volume_clear_size = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] QuobyteHD.volumes_dir = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.ssl = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_notifications.driver = [] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_notifications.retry = -1 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] key_manager.fixed_key = **** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican.barbican_api_version = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican.barbican_endpoint = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican.barbican_endpoint_type = public {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican.barbican_region_name = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican.cafile = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican.certfile = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican.collect_timing = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican.insecure = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican.keyfile = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican.number_of_retries = 60 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican.retry_delay = 1 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican.send_service_user_token = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican.split_loggers = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican.timeout = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican.verify_ssl = True {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican.verify_ssl_path = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican_service_user.auth_section = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican_service_user.auth_type = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican_service_user.cafile = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican_service_user.certfile = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican_service_user.collect_timing = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican_service_user.insecure = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican_service_user.keyfile = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican_service_user.split_loggers = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] barbican_service_user.timeout = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] vault.approle_role_id = **** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] vault.approle_secret_id = **** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] vault.kv_mountpoint = secret {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] vault.kv_path = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] vault.kv_version = 2 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] vault.namespace = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] vault.root_token_id = **** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] vault.ssl_ca_crt_file = None {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] vault.timeout = 60.0 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] vault.use_ssl = False {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:27 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] ******************************************************************************** {{(pid=86407) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 14:25:27 devstack sudo[86628]: pam_unix(sudo:session): session closed for user root Jul 08 14:25:27 devstack cinder-volume[86622]: DEBUG oslo_concurrency.processutils [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.854s {{(pid=86622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:25:27 devstack cinder-volume[86622]: INFO cinder.volume.drivers.quobyte [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad succeeded Jul 08 14:25:27 devstack cinder-volume[86622]: DEBUG cinder.volume.drivers.quobyte [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=86622) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:25:27 devstack cinder-volume[86622]: DEBUG oslo_concurrency.lockutils [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.865s {{(pid=86622) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:25:27 devstack cinder-volume[86622]: DEBUG oslo_concurrency.processutils [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=86622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:25:27 devstack sudo[86697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:25:27 devstack sudo[86697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:25:28 devstack sudo[86697]: pam_unix(sudo:session): session closed for user root Jul 08 14:25:28 devstack cinder-volume[86622]: DEBUG oslo_concurrency.processutils [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.811s {{(pid=86622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:25:28 devstack cinder-volume[86622]: INFO cinder.volume.driver [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 14:25:28 devstack cinder-volume[86622]: DEBUG cinder.volume.driver [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.744213104248, 'free_capacity_gb': 1775.744213104248, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86622) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 14:25:28 devstack cinder-volume[86622]: DEBUG oslo_db.sqlalchemy.engines [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86622) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:25:28 devstack cinder-volume[86622]: DEBUG dbcounter [-] [86622] Writer thread running {{(pid=86622) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 14:25:28 devstack cinder-volume[86622]: DEBUG cinder.db.api [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Building query based on filter {{(pid=86622) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 14:25:28 devstack cinder-volume[86622]: DEBUG cinder.image.image_utils [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86622) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 14:25:28 devstack cinder-volume[86622]: INFO cinder.keymgr.migration [None req-e0bf1e7f-9d87-4d13-8e16-c2164299741e None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 14:25:28 devstack cinder-volume[86622]: DEBUG oslo_concurrency.lockutils [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86622) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:25:28 devstack cinder-volume[86622]: DEBUG oslo_concurrency.lockutils [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86622) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:25:28 devstack cinder-volume[86622]: DEBUG cinder.volume.drivers.quobyte [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=86622) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:25:28 devstack cinder-volume[86622]: DEBUG cinder.volume.drivers.quobyte [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=86622) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:25:28 devstack cinder-volume[86622]: DEBUG oslo_concurrency.lockutils [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86622) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:25:28 devstack cinder-volume[86622]: DEBUG oslo_concurrency.processutils [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=86622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:25:28 devstack sudo[86725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:25:28 devstack sudo[86725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:25:29 devstack sudo[86725]: pam_unix(sudo:session): session closed for user root Jul 08 14:25:29 devstack cinder-volume[86622]: DEBUG oslo_concurrency.processutils [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.062s {{(pid=86622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:25:29 devstack cinder-volume[86622]: DEBUG cinder.manager [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Notifying Schedulers of capabilities ... {{(pid=86622) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:25:29 devstack cinder-volume[86622]: INFO cinder.volume.manager [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Driver initialization completed successfully. Jul 08 14:25:29 devstack cinder-volume[86622]: INFO cinder.manager [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Initiating service 3 cleanup Jul 08 14:25:29 devstack cinder-volume[86622]: INFO cinder.manager [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Service 3 cleanup completed. Jul 08 14:25:29 devstack cinder-volume[86622]: DEBUG cinder.service [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Creating RPC server for service cinder-volume {{(pid=86622) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 14:25:29 devstack cinder-volume[86622]: DEBUG cinder.service [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86622) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 14:25:29 devstack cinder-volume[86622]: INFO cinder.volume.manager [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 14:25:29 devstack cinder-volume[86622]: DEBUG oslo_concurrency.lockutils [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86622) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:25:29 devstack cinder-volume[86622]: DEBUG oslo_concurrency.lockutils [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86622) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:25:29 devstack cinder-volume[86622]: DEBUG cinder.volume.drivers.quobyte [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=86622) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:25:29 devstack cinder-volume[86622]: DEBUG cinder.volume.drivers.quobyte [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=86622) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:25:29 devstack cinder-volume[86622]: DEBUG oslo_concurrency.lockutils [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86622) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:25:29 devstack cinder-volume[86622]: DEBUG oslo_concurrency.processutils [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=86622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:25:29 devstack sudo[86814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:25:29 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:25:30 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root Jul 08 14:25:30 devstack cinder-volume[86622]: DEBUG oslo_concurrency.processutils [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.653s {{(pid=86622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:25:30 devstack cinder-volume[86622]: INFO cinder.volume.manager [None req-e809929e-87f1-4065-bc9a-3c492f48d083 None None] Driver post RPC initialization completed successfully. Jul 08 14:25:32 devstack cinder-volume[86622]: DEBUG oslo_concurrency.lockutils [None req-3571cf97-18b8-4bdb-9e3c-a149ffc0ee79 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86622) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:25:32 devstack cinder-volume[86622]: DEBUG oslo_concurrency.lockutils [None req-3571cf97-18b8-4bdb-9e3c-a149ffc0ee79 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86622) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:25:32 devstack cinder-volume[86622]: DEBUG cinder.volume.drivers.quobyte [None req-3571cf97-18b8-4bdb-9e3c-a149ffc0ee79 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=86622) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:25:32 devstack cinder-volume[86622]: DEBUG cinder.volume.drivers.quobyte [None req-3571cf97-18b8-4bdb-9e3c-a149ffc0ee79 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=86622) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:25:32 devstack cinder-volume[86622]: DEBUG oslo_concurrency.lockutils [None req-3571cf97-18b8-4bdb-9e3c-a149ffc0ee79 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86622) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:25:32 devstack cinder-volume[86622]: DEBUG oslo_concurrency.processutils [None req-3571cf97-18b8-4bdb-9e3c-a149ffc0ee79 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=86622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:25:32 devstack sudo[86861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:25:32 devstack sudo[86861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:25:33 devstack sudo[86861]: pam_unix(sudo:session): session closed for user root Jul 08 14:25:33 devstack cinder-volume[86622]: DEBUG oslo_concurrency.processutils [None req-3571cf97-18b8-4bdb-9e3c-a149ffc0ee79 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.660s {{(pid=86622) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:25:33 devstack cinder-volume[86622]: DEBUG cinder.manager [None req-3571cf97-18b8-4bdb-9e3c-a149ffc0ee79 None None] Notifying Schedulers of capabilities ... {{(pid=86622) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:25:33 devstack cinder-volume[86407]: INFO oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Caught SIGTERM, stopping children Jul 08 14:25:33 devstack cinder-volume[86407]: DEBUG oslo_concurrency.lockutils [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Acquiring lock "singleton_lock" {{(pid=86407) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 14:25:33 devstack cinder-volume[86407]: DEBUG oslo_concurrency.lockutils [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Acquired lock "singleton_lock" {{(pid=86407) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 14:25:33 devstack cinder-volume[86407]: DEBUG oslo_concurrency.lockutils [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Releasing lock "singleton_lock" {{(pid=86407) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 14:25:33 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Stop services. {{(pid=86407) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 14:25:33 devstack cinder-volume[86407]: DEBUG oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Killing children. {{(pid=86407) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 14:25:33 devstack cinder-volume[86407]: INFO oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Waiting on 1 children to exit Jul 08 14:25:38 devstack cinder-volume[86622]: DEBUG oslo_concurrency.lockutils [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Acquiring lock "singleton_lock" {{(pid=86622) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 14:25:38 devstack cinder-volume[86622]: DEBUG oslo_concurrency.lockutils [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Acquired lock "singleton_lock" {{(pid=86622) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 14:25:38 devstack cinder-volume[86622]: DEBUG oslo_concurrency.lockutils [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Releasing lock "singleton_lock" {{(pid=86622) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 14:25:38 devstack cinder-volume[86622]: WARNING amqp [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 14:25:38 devstack cinder-volume[86622]: WARNING amqp [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 14:25:38 devstack cinder-volume[86407]: INFO oslo_service.backend._eventlet.service [None req-838c52fc-caf9-4704-acbf-8b7a173a5010 None None] Child 86622 exited with status 0 Jul 08 14:25:38 devstack cinder-volume[86946]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 14:25:38 devstack cinder-volume[86946]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 14:25:38 devstack cinder-volume[86946]: we strongly recommend against using it for new projects. Jul 08 14:25:38 devstack cinder-volume[86946]: If you are already using Eventlet, we recommend migrating to a different Jul 08 14:25:38 devstack cinder-volume[86946]: framework. For more detail see Jul 08 14:25:38 devstack cinder-volume[86946]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 14:25:38 devstack cinder-volume[86946]: import eventlet # noqa Jul 08 14:25:41 devstack cinder-volume[86946]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86946) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 14:25:41 devstack cinder-volume[86946]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86946) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 14:25:41 devstack cinder-volume[86946]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86946) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 14:25:42 devstack cinder-volume[86946]: INFO dbcounter [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] Registered counter for database cinder Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_db.sqlalchemy.engines [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86946) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG dbcounter [-] [86946] Writer thread running {{(pid=86946) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 14:25:42 devstack cinder-volume[86946]: INFO cinder.rpc [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 14:25:42 devstack cinder-volume[86946]: INFO cinder.rpc [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_db.sqlalchemy.engines [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86946) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:25:42 devstack cinder-volume[86946]: INFO cinder.volume.manager [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] Determined volume DB was empty at startup. Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG cinder.volume.manager [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86946) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 14:25:42 devstack cinder-volume[86946]: WARNING stevedore.named [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 14:25:42 devstack cinder-volume[86946]: WARNING castellan.key_manager [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 14:25:42 devstack cinder-volume[86946]: WARNING cinder.keymgr.conf_key_mgr [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 14:25:42 devstack cinder-volume[86946]: INFO cinder.volume.manager [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_db.sqlalchemy.engines [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86946) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:25:42 devstack cinder-volume[86946]: INFO oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] Starting 1 workers Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] Started child 87240 {{(pid=86946) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] Full set of CONF: {{(pid=86946) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] ******************************************************************************** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] Configuration options gathered from: {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] ================================================================================ {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] allow_availability_zone_fallback = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] allow_compression_on_image_upload = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[87240]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] allowed_direct_url_schemes = [] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] api_rate_limit = True {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] auth_strategy = keystone {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_availability_zone = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_host = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_name = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_stats_polling_interval = 60 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backup_api_class = cinder.backup.api.API {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backup_name_template = backup-%s {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backup_use_same_host = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backup_use_temp_snapshot = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] chap_password = **** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] chap_username = {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cinder_internal_tenant_project_id = 2abed3d1a93f4a1a8847b2d7e1fdd559 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cinder_internal_tenant_user_id = 3c048ee8ec034f4f8f176f92c0ac99aa {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cluster = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] compression_format = gzip {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] compute_api_class = cinder.compute.nova.API {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] config_dir = [] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] config_source = [] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] control_exchange = openstack {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] debug = True {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] default_availability_zone = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] default_group_type = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] default_volume_type = QuobyteHD {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] disk_geometry = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] driver_client_cert = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] driver_client_cert_key = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] driver_data_namespace = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] driver_ssl_cert_path = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] driver_ssl_cert_verify = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] driver_use_ssl = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] enable_new_services = True {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] enable_unsupported_driver = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] enabled_backends = ['QuobyteHD'] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] enforce_multipath_for_image_xfer = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] filter_function = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] glance_api_insecure = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] glance_api_servers = ['http://192.168.122.74/image'] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] glance_api_ssl_compression = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] glance_ca_certificates_file = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] glance_catalog_info = image:glance:publicURL {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] glance_certfile = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] glance_keyfile = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] glance_num_retries = 3 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] glance_request_timeout = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] goodness_function = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] graceful_shutdown_timeout = 5 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] group_api_class = cinder.group.api.API {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] host = devstack {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] image_compress_on_upload = True {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] image_conversion_address_space_limit = 1 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] image_conversion_cpu_limit = 60 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] image_conversion_disable = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] image_upload_use_cinder_backend = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] image_upload_use_internal_tenant = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] image_volume_cache_enabled = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] image_volume_cache_max_count = 0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] image_volume_cache_max_size_gb = 0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] init_host_max_objects_retrieval = 0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] instance_format = [instance: %(uuid)s] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] iscsi_target_flags = {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] iscsi_write_cache = on {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] iser_helper = tgtadm {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] iser_ip_address = 192.168.122.74 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] iser_port = 3260 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] log_color = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] log_config_append = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] log_dir = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] log_file = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] log_options = True {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] log_rotate_interval = 1 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] log_rotate_interval_type = days {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] log_rotation_type = none {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] max_age = 0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] max_logfile_count = 30 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] max_logfile_size_mb = 200 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] max_over_subscription_ratio = 20.0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] message_reap_interval = 86400 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] message_ttl = 2592000 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] migration_create_volume_timeout_secs = 300 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] monkey_patch = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] monkey_patch_modules = [] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] my_ip = 192.168.122.74 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] no_snapshot_gb_quota = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] num_iser_scan_tries = 3 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] num_shell_tries = 3 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] num_volume_device_scan_tries = 3 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] nvmeof_conn_info_version = 1 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] nvmet_ns_id = 10 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] nvmet_port_id = 1 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] osapi_max_limit = 1000 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] osapi_volume_ext_list = [] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] osapi_volume_listen = 0.0.0.0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] osapi_volume_listen_port = 8776 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] osapi_volume_use_ssl = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] osapi_volume_workers = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] per_volume_size_limit = -1 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] periodic_fuzzy_delay = 60 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] periodic_interval = 60 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] project_id_regex = [0-9a-f\-]+ {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] public_endpoint = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] publish_errors = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] quota_backup_gigabytes = 1000 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] quota_backups = 10 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] quota_gigabytes = 1000 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] quota_groups = 10 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] quota_snapshots = 10 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] quota_volumes = 10 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] rate_limit_burst = 0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] rate_limit_except_level = CRITICAL {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] rate_limit_interval = 0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] reinit_driver_count = 3 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] replication_device = **** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] report_discard_supported = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] report_interval = 120 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] reservation_clean_interval = 86400 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] reservation_expire = 86400 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] reserved_image_namespaces = [] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87240) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] reserved_percentage = 0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] rpc_response_timeout = 120 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] run_external_periodic_tasks = True {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] scst_target_driver = iscsi {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] scst_target_iqn_name = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] service_down_time = 720 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] shell_completion = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] snapshot_name_template = snapshot-%s {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] split_loggers = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] state_path = /opt/stack/data/cinder {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] storage_availability_zone = nova {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] storage_protocol = iSCSI {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] syslog_log_facility = LOG_USER {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] target_helper = lioadm {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] target_ip_address = 192.168.122.74 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] target_port = 3260 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] target_protocol = iscsi {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] target_secondary_ip_addresses = [] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] trace_flags = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] transfer_api_class = cinder.transfer.api.API {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] transport_url = **** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] until_refresh = 0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] use_chap_auth = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] use_default_quota_class = True {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] use_journal = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] use_json = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] use_multipath_for_image_xfer = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] use_stderr = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] use_syslog = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] verify_glance_signatures = enabled {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] volume_api_class = cinder.volume.api.API {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] volume_backend_name = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] volume_clear = zero {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] volume_clear_ionice = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] volume_clear_size = 0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] volume_copy_bps_limit = 0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] volume_dd_blocksize = 1M {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] volume_name_template = volume-%s {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] volume_service_inithost_offload = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] volume_usage_audit_period = month {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] zoning_mode = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_concurrency.disable_process_locking = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.auth_section = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.auth_type = password {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.auth_version = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.cache = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.certfile = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.delay_auth_decision = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.http_connect_timeout = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.include_service_catalog = True {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.insecure = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.interface = public {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.keyfile = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.memcache_password = {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.memcache_username = {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.region_name = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.service_token_roles_required = True {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.service_type = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.token_cache_time = 300 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.74/identity {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.backend = dogpile.cache.null {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.backend_argument = **** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.backend_expiration_time = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.config_prefix = cache.oslo {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.debug_cache_backend = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.enable_retry_client = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.enable_socket_keepalive = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.enabled = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.expiration_time = 600 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.hashclient_retry_attempts = 2 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.memcache_dead_retry = 300 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.memcache_pool_maxsize = 10 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.memcache_sasl_enabled = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.password = **** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.proxies = [] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.redis_db = 0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.redis_sentinel_service_name = mymaster {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.redis_server = localhost:6379 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.retry_attempts = 2 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.retry_delay = 0.0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.socket_keepalive_count = 1 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.socket_keepalive_idle = 1 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.socket_keepalive_interval = 1 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.socket_timeout = 1.0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.tls_allowed_ciphers = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.tls_cafile = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.tls_certfile = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.tls_enabled = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.tls_keyfile = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cache.username = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] coordination.backend_url = **** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] database.asyncio_connection = **** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] database.asyncio_slave_connection = **** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] database.backend = sqlalchemy {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] database.connection = **** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] database.connection_debug = 0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] database.connection_parameters = {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] database.connection_recycle_time = 3600 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] database.connection_trace = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] database.db_inc_retry_interval = True {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] database.db_max_retries = 20 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] database.db_max_retry_interval = 10 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] database.db_retry_interval = 1 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] database.max_overflow = 50 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] database.max_pool_size = 5 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] database.max_retries = 10 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] database.mysql_wsrep_sync_wait = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] database.pool_timeout = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] database.retry_interval = 10 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] database.slave_connection = **** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] database.sqlite_synchronous = True {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] database.synchronous_reader = True {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] database.use_db_reconnect = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] profiler.connection_string = messaging:// {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] profiler.enabled = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] profiler.es_doc_type = notification {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] profiler.es_scroll_size = 10000 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] profiler.es_scroll_time = 2m {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] profiler.filter_error_trace = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] profiler.hmac_keys = **** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] profiler.sentinel_service_name = mymaster {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] profiler.socket_timeout = 0.1 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] profiler.trace_requests = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] profiler.trace_sqlalchemy = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] profiler_jaeger.process_tags = {} {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] profiler_jaeger.service_name_prefix = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] profiler_otlp.service_name_prefix = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_policy.enforce_new_defaults = True {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_policy.enforce_scope = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_policy.policy_default_rule = default {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87240) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_policy.policy_file = policy.yaml {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.quobyte [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 14:25:42 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.quobyte [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Running cmd (subprocess): mount.quobyte {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_policy.remote_timeout = 60.0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] privsep_osbrick.group = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] privsep_osbrick.helper_command = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] privsep_osbrick.user = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cinder_sys_admin.group = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cinder_sys_admin.helper_command = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] cinder_sys_admin.user = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] service_user.auth_section = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] service_user.auth_type = password {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] service_user.cafile = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] service_user.certfile = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] service_user.collect_timing = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] service_user.insecure = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] service_user.keyfile = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] service_user.send_service_user_token = True {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] service_user.split_loggers = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] service_user.timeout = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] glance.auth_section = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] glance.auth_type = password {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] glance.certfile = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] glance.collect_timing = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] glance.insecure = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] glance.keyfile = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] glance.region_name = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] glance.split_loggers = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] glance.timeout = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.backend_availability_zone = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.chap_password = **** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.chap_username = {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.disk_geometry = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.driver_client_cert = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.driver_client_cert_key = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.driver_data_namespace = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.driver_use_ssl = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.enable_unsupported_driver = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.extra_capabilities = {} {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.filter_function = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.goodness_function = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.iscsi_target_flags = {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.iscsi_write_cache = on {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.iser_helper = tgtadm {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.iser_ip_address = 192.168.122.74 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.iser_port = 3260 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.nas_host = {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.nas_login = admin {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.nas_mount_options = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.nas_password = **** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.nas_private_key = {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.nas_share_path = {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.nas_ssh_port = 22 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.num_shell_tries = 3 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.nvmet_port_id = 1 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.quobyte_client_cfg = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.quobyte_volume_url = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.replication_device = **** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.report_discard_supported = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.reserved_percentage = 0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.scst_target_driver = iscsi {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.scst_target_iqn_name = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.storage_protocol = iSCSI {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.target_helper = tgtadm {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.target_ip_address = 192.168.122.74 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.target_port = 3260 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.target_protocol = iscsi {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.trace_flags = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.unique_fqdn_network = True {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.use_chap_auth = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.volume_backend_name = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.volume_clear = zero {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.volume_clear_ionice = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.volume_clear_size = 0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_reports.file_event_handler = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_reports.log_dir = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.backend_availability_zone = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.backend_host = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.chap_password = **** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.chap_username = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.chiscsi_conf = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack quobyte-client[87241]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 14:25:42 devstack quobyte-client[87241]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.disk_geometry = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.driver_client_cert = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.driver_client_cert_key = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.driver_data_namespace = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.driver_use_ssl = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.extra_capabilities = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] CMD "mount.quobyte" returned: 1 in 0.058s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.filter_function = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.goodness_function = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.iscsi_target_flags = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.iscsi_write_cache = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.iser_helper = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.iser_ip_address = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.iser_port = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.iser_target_prefix = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.nas_host = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.nas_login = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.nas_mount_options = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.nas_password = **** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.nas_private_key = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.nas_share_path = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.nas_ssh_port = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.num_shell_tries = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.nvmet_ns_id = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.nvmet_port_id = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.replication_device = **** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.report_discard_supported = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.reserved_percentage = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.scst_target_driver = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.storage_protocol = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.target_helper = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.target_ip_address = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.target_port = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.target_prefix = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.target_protocol = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.trace_flags = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.unique_fqdn_network = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.use_chap_auth = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.volume_clear = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.volume_clear_ionice = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.volume_clear_size = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] QuobyteHD.volumes_dir = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack sudo[87245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack sudo[87245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.ssl = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.ssl_version = {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_notifications.driver = [] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_notifications.retry = -1 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] oslo_messaging_notifications.transport_url = **** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] key_manager.fixed_key = **** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican.barbican_api_version = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican.barbican_endpoint = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican.barbican_endpoint_type = public {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican.barbican_region_name = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican.cafile = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican.certfile = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican.collect_timing = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican.insecure = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:42 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican.keyfile = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican.number_of_retries = 60 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican.retry_delay = 1 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican.send_service_user_token = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican.split_loggers = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican.timeout = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican.verify_ssl = True {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican.verify_ssl_path = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican_service_user.auth_section = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican_service_user.auth_type = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican_service_user.cafile = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican_service_user.certfile = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican_service_user.collect_timing = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican_service_user.insecure = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican_service_user.keyfile = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican_service_user.split_loggers = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] barbican_service_user.timeout = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] vault.approle_role_id = **** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] vault.approle_secret_id = **** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] vault.kv_mountpoint = secret {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] vault.kv_path = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] vault.kv_version = 2 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] vault.namespace = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] vault.root_token_id = **** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] vault.ssl_ca_crt_file = None {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] vault.timeout = 60.0 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] vault.use_ssl = False {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 14:25:43 devstack cinder-volume[86946]: DEBUG oslo_service.backend._eventlet.service [None req-9ea19317-cc6a-4f14-9083-9e053f93985f None None] ******************************************************************************** {{(pid=86946) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 14:25:43 devstack sudo[87245]: pam_unix(sudo:session): session closed for user root Jul 08 14:25:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.670s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:25:43 devstack cinder-volume[87240]: INFO cinder.volume.driver [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Driver hasn't implemented _init_vendor_properties() Jul 08 14:25:43 devstack cinder-volume[87240]: DEBUG cinder.volume.driver [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.744213104248, 'free_capacity_gb': 1775.744213104248, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87240) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 14:25:43 devstack cinder-volume[87240]: DEBUG oslo_db.sqlalchemy.engines [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87240) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 14:25:43 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writer thread running {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 14:25:43 devstack cinder-volume[87240]: DEBUG cinder.db.api [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Building query based on filter {{(pid=87240) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 14:25:43 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87240) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 14:25:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:25:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:25:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:25:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:25:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:25:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:25:43 devstack cinder-volume[87240]: INFO cinder.keymgr.migration [None req-0adcec6c-18f0-4eaf-a67c-c6bdd2a77224 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 14:25:43 devstack sudo[87264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:25:43 devstack sudo[87264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:25:44 devstack sudo[87264]: pam_unix(sudo:session): session closed for user root Jul 08 14:25:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.662s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:25:44 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:25:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Driver initialization completed successfully. Jul 08 14:25:44 devstack cinder-volume[87240]: INFO cinder.manager [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Initiating service 3 cleanup Jul 08 14:25:44 devstack cinder-volume[87240]: INFO cinder.manager [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Service 3 cleanup completed. Jul 08 14:25:44 devstack cinder-volume[87240]: DEBUG cinder.service [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Creating RPC server for service cinder-volume {{(pid=87240) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 14:25:44 devstack cinder-volume[87240]: DEBUG cinder.service [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87240) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 14:25:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 14:25:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:25:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:25:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:25:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:25:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:25:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:25:44 devstack sudo[87285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:25:44 devstack sudo[87285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:25:45 devstack sudo[87285]: pam_unix(sudo:session): session closed for user root Jul 08 14:25:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.646s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:25:45 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0a74dcd9-ca34-4baf-92af-4a2adfcc3cb7 None None] Driver post RPC initialization completed successfully. Jul 08 14:25:52 devstack cinder-volume[86946]: DEBUG dbcounter [-] [86946] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86946) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:25:54 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:25:55 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:25:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:25:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 6 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:25:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:26:40 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:26:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Flow 'volume_create_manager' (59607c48-c5c9-4ec0-8613-c832723ee6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:26:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56bd315-a902-486b-8b14-defe6977dca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:26:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d56bd315-a902-486b-8b14-defe6977dca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-490140667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b407e2-d908-43fc-912b-b5317f4e9a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb5ff0e3e5040e98ae627d875f16d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:26:41Z,use_quota=True,user_id='e625e0b016c14cab9b4a93a0847e1753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:26:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f2c3b6-b693-458e-92a6-7d7e3b0e7cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:26:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f2c3b6-b693-458e-92a6-7d7e3b0e7cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:26:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833c915e-d81b-47e0-83a0-80daf31900f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:26:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833c915e-d81b-47e0-83a0-80daf31900f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41b407e2-d908-43fc-912b-b5317f4e9a8e', 'volume_name': 'volume-41b407e2-d908-43fc-912b-b5317f4e9a8e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:26:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d16fe8-d3bc-46cf-9130-91239e16f4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:26:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d16fe8-d3bc-46cf-9130-91239e16f4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:26:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba76976-bd7d-4fb2-82de-a2dfe3be2486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:26:40 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Volume 41b407e2-d908-43fc-912b-b5317f4e9a8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41b407e2-d908-43fc-912b-b5317f4e9a8e', 'volume_size': 1} Jul 08 14:26:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:26:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:26:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-490140667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b407e2-d908-43fc-912b-b5317f4e9a8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb5ff0e3e5040e98ae627d875f16d8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:26:41Z,use_quota=True,user_id='e625e0b016c14cab9b4a93a0847e1753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:26:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Creating volume 41b407e2-d908-43fc-912b-b5317f4e9a8e {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:26:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:26:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:26:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:26:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:26:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:26:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:26:40 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:26:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-41b407e2-d908-43fc-912b-b5317f4e9a8e 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:26:41 devstack sudo[87607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-41b407e2-d908-43fc-912b-b5317f4e9a8e 1073741824 Jul 08 14:26:41 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:26:42 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root Jul 08 14:26:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-41b407e2-d908-43fc-912b-b5317f4e9a8e 1073741824" returned: 0 in 1.221s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:26:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-41b407e2-d908-43fc-912b-b5317f4e9a8e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:26:42 devstack sudo[87928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-41b407e2-d908-43fc-912b-b5317f4e9a8e Jul 08 14:26:42 devstack sudo[87928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:26:43 devstack sudo[87928]: pam_unix(sudo:session): session closed for user root Jul 08 14:26:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-41b407e2-d908-43fc-912b-b5317f4e9a8e" returned: 0 in 0.791s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:26:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] <== create_volume: return (2079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:26:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.082s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:26:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ba76976-bd7d-4fb2-82de-a2dfe3be2486) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41b407e2-d908-43fc-912b-b5317f4e9a8e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:26:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b36344-d08d-404e-a246-47ddd8a87877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:26:43 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Volume volume-41b407e2-d908-43fc-912b-b5317f4e9a8e (41b407e2-d908-43fc-912b-b5317f4e9a8e): created successfully Jul 08 14:26:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b36344-d08d-404e-a246-47ddd8a87877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:26:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Flow 'volume_create_manager' (59607c48-c5c9-4ec0-8613-c832723ee6d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:26:43 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ba275886-6452-42c2-8fe9-ca6623d9d6fc tempest-TaggedAttachmentsTest-865581568 None] Created volume successfully. Jul 08 14:26:53 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:26:53 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:DELETE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:26:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:26:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:26:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:26:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:26:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:26:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:26:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:26:59 devstack sudo[88114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:26:59 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:27:00 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root Jul 08 14:27:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.142s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:27:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:27:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:27:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 6 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:27:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:27:28 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:27:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Flow 'volume_create_manager' (cabc8315-abf7-41c1-a9dc-37c694c1d246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:27:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a31f514-5904-48ec-88d5-4d56b962b3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a31f514-5904-48ec-88d5-4d56b962b3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-805244421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5b9f2b-33ad-4e1d-9567-75c65a1edcde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c60c51c2d99f4d4681169f05ce257267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:27:28Z,use_quota=True,user_id='db9f90060a8c47a5ae118f49903728bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b91e8ea1-5325-48f0-a6aa-d5b7eec4b1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b91e8ea1-5325-48f0-a6aa-d5b7eec4b1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f1bfd6-9405-4433-97e6-31e6a4571ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0f1bfd6-9405-4433-97e6-31e6a4571ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f5b9f2b-33ad-4e1d-9567-75c65a1edcde', 'volume_name': 'volume-4f5b9f2b-33ad-4e1d-9567-75c65a1edcde', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d136d7-1454-446a-803d-19849b64c390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d136d7-1454-446a-803d-19849b64c390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18196c2-189b-4900-9964-dc49bb165ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:28 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Volume 4f5b9f2b-33ad-4e1d-9567-75c65a1edcde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f5b9f2b-33ad-4e1d-9567-75c65a1edcde', 'volume_size': 1} Jul 08 14:27:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:27:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:27:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-805244421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f5b9f2b-33ad-4e1d-9567-75c65a1edcde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c60c51c2d99f4d4681169f05ce257267',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:27:28Z,use_quota=True,user_id='db9f90060a8c47a5ae118f49903728bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:27:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Creating volume 4f5b9f2b-33ad-4e1d-9567-75c65a1edcde {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:27:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:27:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:27:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:27:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:27:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:27:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:27:28 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:27:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4f5b9f2b-33ad-4e1d-9567-75c65a1edcde 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:27:28 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4f5b9f2b-33ad-4e1d-9567-75c65a1edcde 1073741824 Jul 08 14:27:28 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:27:30 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Jul 08 14:27:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4f5b9f2b-33ad-4e1d-9567-75c65a1edcde 1073741824" returned: 0 in 1.978s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:27:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4f5b9f2b-33ad-4e1d-9567-75c65a1edcde {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:27:30 devstack sudo[88433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4f5b9f2b-33ad-4e1d-9567-75c65a1edcde Jul 08 14:27:30 devstack sudo[88433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:27:32 devstack sudo[88433]: pam_unix(sudo:session): session closed for user root Jul 08 14:27:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4f5b9f2b-33ad-4e1d-9567-75c65a1edcde" returned: 0 in 1.830s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:27:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] <== create_volume: return (3923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:27:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.931s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:27:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f18196c2-189b-4900-9964-dc49bb165ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f5b9f2b-33ad-4e1d-9567-75c65a1edcde', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b17238-5a96-4c5b-a74b-60843b7d102c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:32 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Volume volume-4f5b9f2b-33ad-4e1d-9567-75c65a1edcde (4f5b9f2b-33ad-4e1d-9567-75c65a1edcde): created successfully Jul 08 14:27:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49b17238-5a96-4c5b-a74b-60843b7d102c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Flow 'volume_create_manager' (cabc8315-abf7-41c1-a9dc-37c694c1d246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:27:32 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0ef2b19b-ff2a-4334-a1c1-ef9729ca0e38 tempest-VolumesAdminNegativeTest-54140691 None] Created volume successfully. Jul 08 14:27:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] Acquiring lock "cinder-4f5b9f2b-33ad-4e1d-9567-75c65a1edcde-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:27:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] Lock "cinder-4f5b9f2b-33ad-4e1d-9567-75c65a1edcde-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:27:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] Acquiring lock "cinder-quobyte-4f5b9f2b-33ad-4e1d-9567-75c65a1edcde" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:27:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] Lock "cinder-quobyte-4f5b9f2b-33ad-4e1d-9567-75c65a1edcde" acquired by "delete_volume" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:27:35 devstack cinder-volume[87240]: INFO oslo.privsep.daemon [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp0xt0xboi/privsep.sock'] Jul 08 14:27:35 devstack sudo[88481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp0xt0xboi/privsep.sock Jul 08 14:27:35 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:27:36 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 08 14:27:36 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 14:27:36 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 14:27:36 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 14:27:36 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 14:27:36 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 14:27:36 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 14:27:36 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 14:27:36 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 08 14:27:37 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 08 14:27:37 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 14:27:37 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 14:27:37 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 14:27:37 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 14:27:37 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 14:27:37 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 14:27:37 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 14:27:37 devstack cinder-volume[87240]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 08 14:27:38 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root Jul 08 14:27:38 devstack cinder-volume[87240]: INFO oslo.privsep.daemon [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] Spawned new privsep daemon via rootwrap Jul 08 14:27:38 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] Accepted privsep connection to /tmp/tmp0xt0xboi/privsep.sock {{(pid=87240) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 08 14:27:38 devstack cinder-volume[87240]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 08 14:27:38 devstack cinder-volume[87240]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 08 14:27:38 devstack cinder-volume[87240]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 08 14:27:38 devstack cinder-volume[87240]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88506 Jul 08 14:27:38 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f38b9f-37ff-4d56-a2b4-67836dca245b]: (2,) {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:27:38 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8d1e31-60e4-4920-a914-28080d035d58]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:27:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4f5b9f2b-33ad-4e1d-9567-75c65a1edcde {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:27:38 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4f5b9f2b-33ad-4e1d-9567-75c65a1edcde Jul 08 14:27:38 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:27:40 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Jul 08 14:27:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4f5b9f2b-33ad-4e1d-9567-75c65a1edcde" returned: 0 in 2.068s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:27:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4f5b9f2b-33ad-4e1d-9567-75c65a1edcde {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:27:40 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4f5b9f2b-33ad-4e1d-9567-75c65a1edcde Jul 08 14:27:40 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:27:43 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Jul 08 14:27:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4f5b9f2b-33ad-4e1d-9567-75c65a1edcde" returned: 0 in 2.803s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:27:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] Lock "cinder-quobyte-4f5b9f2b-33ad-4e1d-9567-75c65a1edcde" released by "delete_volume" :: held 7.956s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:27:43 devstack cinder-volume[87240]: WARNING cinder.quota [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:27:43 devstack cinder-volume[87240]: WARNING cinder.quota [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:27:43 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] Created reservations ['16e1b9ec-0c0e-44d0-aa34-7aab43b348e6', 'b9d7d645-3148-4c68-ba00-321c4e5d4802', '202c5019-3c37-4ef8-ab9c-ab99015ed462', 'c71ff701-1a57-4667-b9a2-5ea2d863976d'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:27:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:27:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:27:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:27:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:27:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:27:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:27:44 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:27:44 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:27:44 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:27:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Flow 'volume_create_manager' (feec9066-9675-4727-b161-938253f04308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:27:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc416c76-99b1-4a7a-9dd8-953fe7d55636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc416c76-99b1-4a7a-9dd8-953fe7d55636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1467940702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7efb07c19a684fe0a814356b622f6347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:27:45Z,use_quota=True,user_id='cfed700e79a340feb859fd9aaeaac8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6634ca94-e8f3-4893-b146-fda6601022f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6634ca94-e8f3-4893-b146-fda6601022f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f199d862-6cd5-4a18-8e38-aafcd4a254e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f199d862-6cd5-4a18-8e38-aafcd4a254e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6', 'volume_name': 'volume-14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ea5075-a3b7-4539-8c65-21cf4bc8b82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ea5075-a3b7-4539-8c65-21cf4bc8b82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58bf66ff-6824-42d5-8b03-ccd4ac6f32b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:45 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Volume 14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6', 'volume_size': 1} Jul 08 14:27:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:27:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:27:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1467940702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7efb07c19a684fe0a814356b622f6347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:27:45Z,use_quota=True,user_id='cfed700e79a340feb859fd9aaeaac8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:27:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Creating volume 14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:27:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:27:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:27:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:27:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:27:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:27:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:27:45 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:27:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:27:45 devstack sudo[88585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6 1073741824 Jul 08 14:27:45 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:27:46 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Jul 08 14:27:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 2.854s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:27:46 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:27:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] Deleted volume successfully. Jul 08 14:27:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-38da514b-6537-4f27-9a19-fd003f02e71b tempest-VolumesAdminNegativeTest-54140691 None] Lock "cinder-4f5b9f2b-33ad-4e1d-9567-75c65a1edcde-delete_volume" released by "delete_volume" :: held 11.646s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:27:47 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root Jul 08 14:27:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6 1073741824" returned: 0 in 2.564s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:27:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:27:48 devstack sudo[88608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6 Jul 08 14:27:48 devstack sudo[88608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:27:49 devstack sudo[88608]: pam_unix(sudo:session): session closed for user root Jul 08 14:27:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6" returned: 0 in 1.315s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] <== create_volume: return (4077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:27:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.080s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58bf66ff-6824-42d5-8b03-ccd4ac6f32b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc0922e-d354-4596-aaed-135c4bd340d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:27:49 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Volume volume-14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6 (14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6): created successfully Jul 08 14:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc0922e-d354-4596-aaed-135c4bd340d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:27:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Flow 'volume_create_manager' (feec9066-9675-4727-b161-938253f04308) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:27:49 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a59cb240-9a36-4f9d-80f7-0d81c9b1f95e tempest-ServerRescueNegativeTestJSON-891267489 None] Created volume successfully. Jul 08 14:27:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:27:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:27:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:27:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:27:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:27:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:27:59 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:27:59 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:27:59 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=18,cinder:SELECT=6,cinder:INSERT=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:27:59 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=13,cinder:INSERT=5,cinder:UPDATE=11,cinder:DELETE=3 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:28:00 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.970s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:28:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:28:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 8 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:28:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:28:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-479f53f4-5e51-4f2a-acab-b41aeb7992c1 tempest-ServerRescueNegativeTestJSON-891267489 None] Acquiring lock "cinder-14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:28:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-479f53f4-5e51-4f2a-acab-b41aeb7992c1 tempest-ServerRescueNegativeTestJSON-891267489 None] Lock "cinder-14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:28:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-479f53f4-5e51-4f2a-acab-b41aeb7992c1 tempest-ServerRescueNegativeTestJSON-891267489 None] Acquiring lock "cinder-quobyte-14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:28:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-479f53f4-5e51-4f2a-acab-b41aeb7992c1 tempest-ServerRescueNegativeTestJSON-891267489 None] Lock "cinder-quobyte-14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6" acquired by "delete_volume" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:28:13 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0147728-7667-4c24-b9da-2c69c11f5b98]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:28:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-479f53f4-5e51-4f2a-acab-b41aeb7992c1 tempest-ServerRescueNegativeTestJSON-891267489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:13 devstack sudo[88892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6 Jul 08 14:28:13 devstack sudo[88892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:14 devstack sudo[88892]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-479f53f4-5e51-4f2a-acab-b41aeb7992c1 tempest-ServerRescueNegativeTestJSON-891267489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6" returned: 0 in 1.460s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-479f53f4-5e51-4f2a-acab-b41aeb7992c1 tempest-ServerRescueNegativeTestJSON-891267489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:14 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6 Jul 08 14:28:14 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:16 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-479f53f4-5e51-4f2a-acab-b41aeb7992c1 tempest-ServerRescueNegativeTestJSON-891267489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6" returned: 0 in 1.624s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-479f53f4-5e51-4f2a-acab-b41aeb7992c1 tempest-ServerRescueNegativeTestJSON-891267489 None] Lock "cinder-quobyte-14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6" released by "delete_volume" :: held 3.178s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-479f53f4-5e51-4f2a-acab-b41aeb7992c1 tempest-ServerRescueNegativeTestJSON-891267489 None] Created reservations ['ba754596-8b3e-4231-97f9-f7680cea9aed', '60ba0c5b-9e5a-40cb-aede-18c32fd35e2e', '65fac18c-1aa0-4227-b05f-de744f9f7d41', 'a959f6ea-b0ee-4fd8-b804-572c3b77c82c'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-479f53f4-5e51-4f2a-acab-b41aeb7992c1 tempest-ServerRescueNegativeTestJSON-891267489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-479f53f4-5e51-4f2a-acab-b41aeb7992c1 tempest-ServerRescueNegativeTestJSON-891267489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-479f53f4-5e51-4f2a-acab-b41aeb7992c1 tempest-ServerRescueNegativeTestJSON-891267489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-479f53f4-5e51-4f2a-acab-b41aeb7992c1 tempest-ServerRescueNegativeTestJSON-891267489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-479f53f4-5e51-4f2a-acab-b41aeb7992c1 tempest-ServerRescueNegativeTestJSON-891267489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-479f53f4-5e51-4f2a-acab-b41aeb7992c1 tempest-ServerRescueNegativeTestJSON-891267489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:16 devstack sudo[88911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:28:16 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Flow 'volume_create_manager' (b6764e3c-83a4-4132-b0ca-dfe70d69480f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f77d82-d623-4d33-8272-8b62d64f0e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f77d82-d623-4d33-8272-8b62d64f0e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1501308699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb84f6e-c2a3-4576-934c-09b134467c6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56789fcc209444c3819f8ecc489c7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:28:17Z,use_quota=True,user_id='443513ac117b498ea327a896db8e3ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1191ea9b-799d-46d4-83aa-7704a0cca3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1191ea9b-799d-46d4-83aa-7704a0cca3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b50bb57-2b01-48e8-b6e9-953c9766031c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b50bb57-2b01-48e8-b6e9-953c9766031c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb84f6e-c2a3-4576-934c-09b134467c6d', 'volume_name': 'volume-1eb84f6e-c2a3-4576-934c-09b134467c6d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ea8cc2-90d0-41ac-92d9-dba2c536a792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ea8cc2-90d0-41ac-92d9-dba2c536a792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97264f16-140e-4819-a0b8-0c5c21b7dfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:28:16 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Volume 1eb84f6e-c2a3-4576-934c-09b134467c6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb84f6e-c2a3-4576-934c-09b134467c6d', 'volume_size': 1} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:28:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1501308699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb84f6e-c2a3-4576-934c-09b134467c6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56789fcc209444c3819f8ecc489c7f8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:28:17Z,use_quota=True,user_id='443513ac117b498ea327a896db8e3ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Creating volume 1eb84f6e-c2a3-4576-934c-09b134467c6d {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:28:16 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:28:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1eb84f6e-c2a3-4576-934c-09b134467c6d 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:17 devstack sudo[88913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1eb84f6e-c2a3-4576-934c-09b134467c6d 1073741824 Jul 08 14:28:17 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:18 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-479f53f4-5e51-4f2a-acab-b41aeb7992c1 tempest-ServerRescueNegativeTestJSON-891267489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.546s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:18 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-479f53f4-5e51-4f2a-acab-b41aeb7992c1 tempest-ServerRescueNegativeTestJSON-891267489 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:28:18 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-479f53f4-5e51-4f2a-acab-b41aeb7992c1 tempest-ServerRescueNegativeTestJSON-891267489 None] Deleted volume successfully. Jul 08 14:28:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-479f53f4-5e51-4f2a-acab-b41aeb7992c1 tempest-ServerRescueNegativeTestJSON-891267489 None] Lock "cinder-14806cdb-0ce6-4b1e-a74e-b2d9a093a7b6-delete_volume" released by "delete_volume" :: held 5.189s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:28:19 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1eb84f6e-c2a3-4576-934c-09b134467c6d 1073741824" returned: 0 in 2.151s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1eb84f6e-c2a3-4576-934c-09b134467c6d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:19 devstack sudo[88928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1eb84f6e-c2a3-4576-934c-09b134467c6d Jul 08 14:28:19 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:21 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1eb84f6e-c2a3-4576-934c-09b134467c6d" returned: 0 in 2.573s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:21 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] <== create_volume: return (4797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:28:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.810s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:28:21 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97264f16-140e-4819-a0b8-0c5c21b7dfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb84f6e-c2a3-4576-934c-09b134467c6d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:28:21 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c5b796-b209-4bf0-afea-97350a04a6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:28:21 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Volume volume-1eb84f6e-c2a3-4576-934c-09b134467c6d (1eb84f6e-c2a3-4576-934c-09b134467c6d): created successfully Jul 08 14:28:21 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80c5b796-b209-4bf0-afea-97350a04a6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:28:21 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Flow 'volume_create_manager' (b6764e3c-83a4-4132-b0ca-dfe70d69480f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:28:21 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-1fcb6188-10c2-412b-b683-add85f16abf0 tempest-DeleteServersTestJSON-1461969687 None] Created volume successfully. Jul 08 14:28:24 devstack cinder-volume[87240]: WARNING py.warnings [req-b35d0454-b049-4ae2-a827-62066d235ffc req-0e0e3412-56f5-4902-bd49-8c84b090536e tempest-TaggedAttachmentsTest-865581568 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 08 14:28:24 devstack cinder-volume[87240]: .first() Jul 08 14:28:24 devstack cinder-volume[87240]: Jul 08 14:28:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-b35d0454-b049-4ae2-a827-62066d235ffc req-0e0e3412-56f5-4902-bd49-8c84b090536e tempest-TaggedAttachmentsTest-865581568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:28:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-b35d0454-b049-4ae2-a827-62066d235ffc req-0e0e3412-56f5-4902-bd49-8c84b090536e tempest-TaggedAttachmentsTest-865581568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:28:24 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7677fd9c-677d-411f-bacf-562c060129d7]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:28:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-b35d0454-b049-4ae2-a827-62066d235ffc req-0e0e3412-56f5-4902-bd49-8c84b090536e tempest-TaggedAttachmentsTest-865581568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-41b407e2-d908-43fc-912b-b5317f4e9a8e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:25 devstack sudo[88976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-41b407e2-d908-43fc-912b-b5317f4e9a8e Jul 08 14:28:25 devstack sudo[88976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:26 devstack sudo[88976]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-b35d0454-b049-4ae2-a827-62066d235ffc req-0e0e3412-56f5-4902-bd49-8c84b090536e tempest-TaggedAttachmentsTest-865581568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-41b407e2-d908-43fc-912b-b5317f4e9a8e" returned: 0 in 1.712s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-b35d0454-b049-4ae2-a827-62066d235ffc req-0e0e3412-56f5-4902-bd49-8c84b090536e tempest-TaggedAttachmentsTest-865581568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.740s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:28:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-b35d0454-b049-4ae2-a827-62066d235ffc req-0e0e3412-56f5-4902-bd49-8c84b090536e tempest-TaggedAttachmentsTest-865581568 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad', 'name': 'volume-41b407e2-d908-43fc-912b-b5317f4e9a8e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71b4bbc3-6a7e-492b-a886-53262dff7c8f', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:28:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-b35d0454-b049-4ae2-a827-62066d235ffc req-0e0e3412-56f5-4902-bd49-8c84b090536e tempest-TaggedAttachmentsTest-865581568 None] attachment_update completed successfully. Jul 08 14:28:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-86daf17d-dd8b-4135-b696-8dbc9fa64557 req-86c10145-6905-4404-a894-bfc8e69059d5 tempest-DeleteServersTestJSON-1461969687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:28:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-86daf17d-dd8b-4135-b696-8dbc9fa64557 req-86c10145-6905-4404-a894-bfc8e69059d5 tempest-DeleteServersTestJSON-1461969687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:28:28 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bfe2f4-3f02-4d66-8185-b4371e70e936]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:28:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-86daf17d-dd8b-4135-b696-8dbc9fa64557 req-86c10145-6905-4404-a894-bfc8e69059d5 tempest-DeleteServersTestJSON-1461969687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1eb84f6e-c2a3-4576-934c-09b134467c6d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:28 devstack sudo[89066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1eb84f6e-c2a3-4576-934c-09b134467c6d Jul 08 14:28:28 devstack sudo[89066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:30 devstack sudo[89066]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-86daf17d-dd8b-4135-b696-8dbc9fa64557 req-86c10145-6905-4404-a894-bfc8e69059d5 tempest-DeleteServersTestJSON-1461969687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1eb84f6e-c2a3-4576-934c-09b134467c6d" returned: 0 in 1.824s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-86daf17d-dd8b-4135-b696-8dbc9fa64557 req-86c10145-6905-4404-a894-bfc8e69059d5 tempest-DeleteServersTestJSON-1461969687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.898s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:28:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-86daf17d-dd8b-4135-b696-8dbc9fa64557 req-86c10145-6905-4404-a894-bfc8e69059d5 tempest-DeleteServersTestJSON-1461969687 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad', 'name': 'volume-1eb84f6e-c2a3-4576-934c-09b134467c6d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb556f43-5f4b-4ebe-b4ea-a365c08c66ec', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:28:30 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-86daf17d-dd8b-4135-b696-8dbc9fa64557 req-86c10145-6905-4404-a894-bfc8e69059d5 tempest-DeleteServersTestJSON-1461969687 None] attachment_update completed successfully. Jul 08 14:28:34 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-bbd3ea20-9748-47e5-a181-186779cabb20 req-071242fd-c34e-4c22-80c4-e05373a8b536 tempest-TaggedAttachmentsTest-865581568 None] Terminate volume connection completed successfully. Jul 08 14:28:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-bbd3ea20-9748-47e5-a181-186779cabb20 req-071242fd-c34e-4c22-80c4-e05373a8b536 tempest-TaggedAttachmentsTest-865581568 None] Deleting attachment 71b4bbc3-6a7e-492b-a886-53262dff7c8f. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:28:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-920d2505-5f6b-41a2-ae82-95b05cf62ac3 req-c820bfa5-d8d5-4fb7-a5fa-2f644e13ca8d tempest-DeleteServersTestJSON-1461969687 None] Terminate volume connection completed successfully. Jul 08 14:28:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-920d2505-5f6b-41a2-ae82-95b05cf62ac3 req-c820bfa5-d8d5-4fb7-a5fa-2f644e13ca8d tempest-DeleteServersTestJSON-1461969687 None] Deleting attachment cb556f43-5f4b-4ebe-b4ea-a365c08c66ec. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:28:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5f4e38e8-0238-4142-9fdc-39ec53322e9c tempest-DeleteServersTestJSON-1461969687 None] Acquiring lock "cinder-1eb84f6e-c2a3-4576-934c-09b134467c6d-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:28:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5f4e38e8-0238-4142-9fdc-39ec53322e9c tempest-DeleteServersTestJSON-1461969687 None] Lock "cinder-1eb84f6e-c2a3-4576-934c-09b134467c6d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:28:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5f4e38e8-0238-4142-9fdc-39ec53322e9c tempest-DeleteServersTestJSON-1461969687 None] Acquiring lock "cinder-quobyte-1eb84f6e-c2a3-4576-934c-09b134467c6d" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:28:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5f4e38e8-0238-4142-9fdc-39ec53322e9c tempest-DeleteServersTestJSON-1461969687 None] Lock "cinder-quobyte-1eb84f6e-c2a3-4576-934c-09b134467c6d" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:28:46 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[096483dd-c60c-4ed4-aea1-958a94169dc6]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:28:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5f4e38e8-0238-4142-9fdc-39ec53322e9c tempest-DeleteServersTestJSON-1461969687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1eb84f6e-c2a3-4576-934c-09b134467c6d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:46 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1eb84f6e-c2a3-4576-934c-09b134467c6d Jul 08 14:28:46 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:47 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5f4e38e8-0238-4142-9fdc-39ec53322e9c tempest-DeleteServersTestJSON-1461969687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1eb84f6e-c2a3-4576-934c-09b134467c6d" returned: 0 in 0.952s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5f4e38e8-0238-4142-9fdc-39ec53322e9c tempest-DeleteServersTestJSON-1461969687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1eb84f6e-c2a3-4576-934c-09b134467c6d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:47 devstack sudo[89571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1eb84f6e-c2a3-4576-934c-09b134467c6d Jul 08 14:28:47 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:48 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5f4e38e8-0238-4142-9fdc-39ec53322e9c tempest-DeleteServersTestJSON-1461969687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1eb84f6e-c2a3-4576-934c-09b134467c6d" returned: 0 in 0.967s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5f4e38e8-0238-4142-9fdc-39ec53322e9c tempest-DeleteServersTestJSON-1461969687 None] Lock "cinder-quobyte-1eb84f6e-c2a3-4576-934c-09b134467c6d" released by "delete_volume" :: held 1.965s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:28:48 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-5f4e38e8-0238-4142-9fdc-39ec53322e9c tempest-DeleteServersTestJSON-1461969687 None] Created reservations ['58c66894-ece5-48c1-b958-3357f6bee6c1', 'b3dfb29f-2468-4eea-a16a-726faeb9f7c6', 'b3a58d6d-d087-45ce-a5d0-14761f7956ac', '39cdc861-1953-4a54-8192-e38b1b43ea20'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:28:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5f4e38e8-0238-4142-9fdc-39ec53322e9c tempest-DeleteServersTestJSON-1461969687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:28:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5f4e38e8-0238-4142-9fdc-39ec53322e9c tempest-DeleteServersTestJSON-1461969687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:28:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5f4e38e8-0238-4142-9fdc-39ec53322e9c tempest-DeleteServersTestJSON-1461969687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:28:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5f4e38e8-0238-4142-9fdc-39ec53322e9c tempest-DeleteServersTestJSON-1461969687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:28:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5f4e38e8-0238-4142-9fdc-39ec53322e9c tempest-DeleteServersTestJSON-1461969687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:28:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5f4e38e8-0238-4142-9fdc-39ec53322e9c tempest-DeleteServersTestJSON-1461969687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:49 devstack sudo[89576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:28:49 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:49 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root Jul 08 14:28:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5f4e38e8-0238-4142-9fdc-39ec53322e9c tempest-DeleteServersTestJSON-1461969687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.724s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:28:49 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-5f4e38e8-0238-4142-9fdc-39ec53322e9c tempest-DeleteServersTestJSON-1461969687 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:28:49 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5f4e38e8-0238-4142-9fdc-39ec53322e9c tempest-DeleteServersTestJSON-1461969687 None] Deleted volume successfully. Jul 08 14:28:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5f4e38e8-0238-4142-9fdc-39ec53322e9c tempest-DeleteServersTestJSON-1461969687 None] Lock "cinder-1eb84f6e-c2a3-4576-934c-09b134467c6d-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:28:59 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=18,cinder:UPDATE=24,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:28:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:28:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:28:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:28:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:28:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:28:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:28:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:28:59 devstack sudo[89628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:28:59 devstack sudo[89628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:28:59 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=32,cinder:INSERT=5,cinder:UPDATE=20,cinder:DELETE=2 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:29:00 devstack sudo[89628]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.182s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:29:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:29:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 8 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:29:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:29:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e031e16d-34f9-49b5-a0cd-8fbeac1b6969 tempest-TaggedAttachmentsTest-865581568 None] Acquiring lock "cinder-41b407e2-d908-43fc-912b-b5317f4e9a8e-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:29:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e031e16d-34f9-49b5-a0cd-8fbeac1b6969 tempest-TaggedAttachmentsTest-865581568 None] Lock "cinder-41b407e2-d908-43fc-912b-b5317f4e9a8e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:29:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e031e16d-34f9-49b5-a0cd-8fbeac1b6969 tempest-TaggedAttachmentsTest-865581568 None] Acquiring lock "cinder-quobyte-41b407e2-d908-43fc-912b-b5317f4e9a8e" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:29:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e031e16d-34f9-49b5-a0cd-8fbeac1b6969 tempest-TaggedAttachmentsTest-865581568 None] Lock "cinder-quobyte-41b407e2-d908-43fc-912b-b5317f4e9a8e" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:29:06 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f01c8e-2dd6-45e4-b99e-7c17a16b24d7]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:29:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e031e16d-34f9-49b5-a0cd-8fbeac1b6969 tempest-TaggedAttachmentsTest-865581568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-41b407e2-d908-43fc-912b-b5317f4e9a8e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:06 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-41b407e2-d908-43fc-912b-b5317f4e9a8e Jul 08 14:29:06 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:07 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e031e16d-34f9-49b5-a0cd-8fbeac1b6969 tempest-TaggedAttachmentsTest-865581568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-41b407e2-d908-43fc-912b-b5317f4e9a8e" returned: 0 in 1.155s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e031e16d-34f9-49b5-a0cd-8fbeac1b6969 tempest-TaggedAttachmentsTest-865581568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-41b407e2-d908-43fc-912b-b5317f4e9a8e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:07 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-41b407e2-d908-43fc-912b-b5317f4e9a8e Jul 08 14:29:07 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:08 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e031e16d-34f9-49b5-a0cd-8fbeac1b6969 tempest-TaggedAttachmentsTest-865581568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-41b407e2-d908-43fc-912b-b5317f4e9a8e" returned: 0 in 0.810s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e031e16d-34f9-49b5-a0cd-8fbeac1b6969 tempest-TaggedAttachmentsTest-865581568 None] Lock "cinder-quobyte-41b407e2-d908-43fc-912b-b5317f4e9a8e" released by "delete_volume" :: held 2.028s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:29:08 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-e031e16d-34f9-49b5-a0cd-8fbeac1b6969 tempest-TaggedAttachmentsTest-865581568 None] Created reservations ['fa8bc49c-e362-4122-bf5b-237fe2ffee35', '22520c3f-e9bc-41e2-a58d-5c42f033ce6d', 'd20ace09-30bd-4a33-affe-902868b4b8e2', 'fbdb06df-569e-4a7b-909e-7259343c7cfb'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:29:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e031e16d-34f9-49b5-a0cd-8fbeac1b6969 tempest-TaggedAttachmentsTest-865581568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e031e16d-34f9-49b5-a0cd-8fbeac1b6969 tempest-TaggedAttachmentsTest-865581568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e031e16d-34f9-49b5-a0cd-8fbeac1b6969 tempest-TaggedAttachmentsTest-865581568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:29:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e031e16d-34f9-49b5-a0cd-8fbeac1b6969 tempest-TaggedAttachmentsTest-865581568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:29:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e031e16d-34f9-49b5-a0cd-8fbeac1b6969 tempest-TaggedAttachmentsTest-865581568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e031e16d-34f9-49b5-a0cd-8fbeac1b6969 tempest-TaggedAttachmentsTest-865581568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:08 devstack sudo[89660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:29:08 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:09 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e031e16d-34f9-49b5-a0cd-8fbeac1b6969 tempest-TaggedAttachmentsTest-865581568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.074s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:09 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-e031e16d-34f9-49b5-a0cd-8fbeac1b6969 tempest-TaggedAttachmentsTest-865581568 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:29:09 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e031e16d-34f9-49b5-a0cd-8fbeac1b6969 tempest-TaggedAttachmentsTest-865581568 None] Deleted volume successfully. Jul 08 14:29:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e031e16d-34f9-49b5-a0cd-8fbeac1b6969 tempest-TaggedAttachmentsTest-865581568 None] Lock "cinder-41b407e2-d908-43fc-912b-b5317f4e9a8e-delete_volume" released by "delete_volume" :: held 3.404s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:29:18 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=2 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:29:19 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:29:53 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:29:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Flow 'volume_create_manager' (64736db0-d8b8-41c9-b69c-08c4b933a60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:29:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3f3539-e308-4fac-bdd8-088021383681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea3f3539-e308-4fac-bdd8-088021383681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1416550440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4af1eb44-7ceb-4194-8901-8747fe3f446d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f9b9dc0c2341d79b1b4d1e3e489dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:29:53Z,use_quota=True,user_id='1bc2f21b0c9a4d1f8a5e43a0d23745cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e23425a5-c786-408a-a9d5-5dabf7c72388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e23425a5-c786-408a-a9d5-5dabf7c72388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b64487fe-bed9-4d03-9908-a9b076c5ba70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b64487fe-bed9-4d03-9908-a9b076c5ba70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4af1eb44-7ceb-4194-8901-8747fe3f446d', 'volume_name': 'volume-4af1eb44-7ceb-4194-8901-8747fe3f446d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3204b33a-dced-4781-9c5d-afe1e0d6119b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3204b33a-dced-4781-9c5d-afe1e0d6119b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863cee65-6040-428a-bf17-ec73ecaae257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:53 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Volume 4af1eb44-7ceb-4194-8901-8747fe3f446d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4af1eb44-7ceb-4194-8901-8747fe3f446d', 'volume_size': 1} Jul 08 14:29:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1416550440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4af1eb44-7ceb-4194-8901-8747fe3f446d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81f9b9dc0c2341d79b1b4d1e3e489dc4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:29:53Z,use_quota=True,user_id='1bc2f21b0c9a4d1f8a5e43a0d23745cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:29:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Creating volume 4af1eb44-7ceb-4194-8901-8747fe3f446d {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:29:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:29:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:29:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:29:53 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:29:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4af1eb44-7ceb-4194-8901-8747fe3f446d 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:53 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4af1eb44-7ceb-4194-8901-8747fe3f446d 1073741824 Jul 08 14:29:53 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:54 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4af1eb44-7ceb-4194-8901-8747fe3f446d 1073741824" returned: 0 in 0.995s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4af1eb44-7ceb-4194-8901-8747fe3f446d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:54 devstack sudo[90069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4af1eb44-7ceb-4194-8901-8747fe3f446d Jul 08 14:29:54 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:29:55 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root Jul 08 14:29:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4af1eb44-7ceb-4194-8901-8747fe3f446d" returned: 0 in 1.098s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:29:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] <== create_volume: return (2161ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:29:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.164s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863cee65-6040-428a-bf17-ec73ecaae257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4af1eb44-7ceb-4194-8901-8747fe3f446d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e58aa26-5ff9-4e86-a9ce-6955ca27f97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:29:55 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Volume volume-4af1eb44-7ceb-4194-8901-8747fe3f446d (4af1eb44-7ceb-4194-8901-8747fe3f446d): created successfully Jul 08 14:29:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e58aa26-5ff9-4e86-a9ce-6955ca27f97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:29:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Flow 'volume_create_manager' (64736db0-d8b8-41c9-b69c-08c4b933a60d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:29:55 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7c0047c7-da22-427c-923d-a12420929f3f tempest-AttachVolumeShelveTestJSON-151046349 None] Created volume successfully. Jul 08 14:29:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:29:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:29:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:29:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:29:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:29:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:29:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:29:59 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:29:59 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:00 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.872s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:30:05 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=5 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:30:05 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:30:06 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:30:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Flow 'volume_create_manager' (59d4282f-a5d6-4f0a-bb13-918c375eaebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996f8a2d-25a8-447b-b65b-e95b45962f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996f8a2d-25a8-447b-b65b-e95b45962f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-111960047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8635c3c7-2723-4a4a-b835-d686023bd89d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48483ad562f441158d14a2eee3013bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:07Z,use_quota=True,user_id='f706d1c701ea4e67a1a6571345e20a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aae687b-763b-4e35-84b9-62820c29cb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aae687b-763b-4e35-84b9-62820c29cb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd50dc8-eb2e-4563-92be-d2e51fb5bee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd50dc8-eb2e-4563-92be-d2e51fb5bee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8635c3c7-2723-4a4a-b835-d686023bd89d', 'volume_name': 'volume-8635c3c7-2723-4a4a-b835-d686023bd89d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a389cdec-8f1b-4eec-85e2-ee4fd8428668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a389cdec-8f1b-4eec-85e2-ee4fd8428668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f931bc5-4360-4c26-b23d-f582529c05ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:07 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Volume 8635c3c7-2723-4a4a-b835-d686023bd89d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8635c3c7-2723-4a4a-b835-d686023bd89d', 'volume_size': 1} Jul 08 14:30:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:30:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-111960047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8635c3c7-2723-4a4a-b835-d686023bd89d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48483ad562f441158d14a2eee3013bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:07Z,use_quota=True,user_id='f706d1c701ea4e67a1a6571345e20a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:30:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Creating volume 8635c3c7-2723-4a4a-b835-d686023bd89d {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:30:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:30:07 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:30:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8635c3c7-2723-4a4a-b835-d686023bd89d 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:07 devstack sudo[90288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8635c3c7-2723-4a4a-b835-d686023bd89d 1073741824 Jul 08 14:30:07 devstack sudo[90288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:09 devstack sudo[90288]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8635c3c7-2723-4a4a-b835-d686023bd89d 1073741824" returned: 0 in 2.476s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8635c3c7-2723-4a4a-b835-d686023bd89d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:09 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8635c3c7-2723-4a4a-b835-d686023bd89d Jul 08 14:30:09 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:11 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8635c3c7-2723-4a4a-b835-d686023bd89d" returned: 0 in 1.681s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] <== create_volume: return (4249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:30:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.263s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f931bc5-4360-4c26-b23d-f582529c05ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8635c3c7-2723-4a4a-b835-d686023bd89d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54326050-1b36-4b25-908e-fb0fde276c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:11 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Volume volume-8635c3c7-2723-4a4a-b835-d686023bd89d (8635c3c7-2723-4a4a-b835-d686023bd89d): created successfully Jul 08 14:30:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54326050-1b36-4b25-908e-fb0fde276c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Flow 'volume_create_manager' (59d4282f-a5d6-4f0a-bb13-918c375eaebb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:11 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-774e28f8-41e1-4767-a584-5b49d3f9096c tempest-AttachVolumeTestJSON-723745895 None] Created volume successfully. Jul 08 14:30:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-524d53eb-1691-4b34-ba60-3697e5e8b1c1 req-813a03ac-624c-41a9-8e6c-9ac4d77ce3f1 tempest-AttachVolumeTestJSON-723745895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-524d53eb-1691-4b34-ba60-3697e5e8b1c1 req-813a03ac-624c-41a9-8e6c-9ac4d77ce3f1 tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:15 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78c354f-3038-4a69-9dfa-ba6b81a203c7]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:30:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-524d53eb-1691-4b34-ba60-3697e5e8b1c1 req-813a03ac-624c-41a9-8e6c-9ac4d77ce3f1 tempest-AttachVolumeTestJSON-723745895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8635c3c7-2723-4a4a-b835-d686023bd89d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:15 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8635c3c7-2723-4a4a-b835-d686023bd89d Jul 08 14:30:15 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:16 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-524d53eb-1691-4b34-ba60-3697e5e8b1c1 req-813a03ac-624c-41a9-8e6c-9ac4d77ce3f1 tempest-AttachVolumeTestJSON-723745895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8635c3c7-2723-4a4a-b835-d686023bd89d" returned: 0 in 1.150s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-524d53eb-1691-4b34-ba60-3697e5e8b1c1 req-813a03ac-624c-41a9-8e6c-9ac4d77ce3f1 tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.182s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-524d53eb-1691-4b34-ba60-3697e5e8b1c1 req-813a03ac-624c-41a9-8e6c-9ac4d77ce3f1 tempest-AttachVolumeTestJSON-723745895 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad', 'name': 'volume-8635c3c7-2723-4a4a-b835-d686023bd89d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2cb0ac5b-9760-422f-a66c-5638a924f3e7', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:30:17 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-524d53eb-1691-4b34-ba60-3697e5e8b1c1 req-813a03ac-624c-41a9-8e6c-9ac4d77ce3f1 tempest-AttachVolumeTestJSON-723745895 None] attachment_update completed successfully. Jul 08 14:30:18 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:30:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Flow 'volume_create_manager' (7d8c3f0c-35f7-4530-90a9-e41d4d714950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb16ea6-e132-4f45-ac7d-d465ae7e7d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fb16ea6-e132-4f45-ac7d-d465ae7e7d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-826875568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59f58f5e-c4f8-494d-92fb-01cef4f0022f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70108b44a70a4fee9e90817df729ed7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:18Z,use_quota=True,user_id='31fdf0ffe99e48d3b9ae07e7abeca861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a5b39c-d4cf-418e-afb6-2bbf818e777f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12a5b39c-d4cf-418e-afb6-2bbf818e777f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd5f6c00-9696-473e-b17b-0f5e9663ba52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd5f6c00-9696-473e-b17b-0f5e9663ba52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59f58f5e-c4f8-494d-92fb-01cef4f0022f', 'volume_name': 'volume-59f58f5e-c4f8-494d-92fb-01cef4f0022f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4531108-783f-40d3-9517-687bafe3c6e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4531108-783f-40d3-9517-687bafe3c6e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943a54b2-332f-4926-adb8-756b329be6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:18 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Volume 59f58f5e-c4f8-494d-92fb-01cef4f0022f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59f58f5e-c4f8-494d-92fb-01cef4f0022f', 'volume_size': 1} Jul 08 14:30:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:30:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-826875568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59f58f5e-c4f8-494d-92fb-01cef4f0022f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70108b44a70a4fee9e90817df729ed7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:18Z,use_quota=True,user_id='31fdf0ffe99e48d3b9ae07e7abeca861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:30:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Creating volume 59f58f5e-c4f8-494d-92fb-01cef4f0022f {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:30:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:30:18 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:30:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59f58f5e-c4f8-494d-92fb-01cef4f0022f 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:18 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59f58f5e-c4f8-494d-92fb-01cef4f0022f 1073741824 Jul 08 14:30:18 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:19 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59f58f5e-c4f8-494d-92fb-01cef4f0022f 1073741824" returned: 0 in 1.207s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59f58f5e-c4f8-494d-92fb-01cef4f0022f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:19 devstack sudo[90763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59f58f5e-c4f8-494d-92fb-01cef4f0022f Jul 08 14:30:19 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:20 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59f58f5e-c4f8-494d-92fb-01cef4f0022f" returned: 0 in 0.926s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] <== create_volume: return (2189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:30:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.193s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (943a54b2-332f-4926-adb8-756b329be6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59f58f5e-c4f8-494d-92fb-01cef4f0022f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41a6d95a-2b0c-4e48-8549-64e526f67d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:20 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Volume volume-59f58f5e-c4f8-494d-92fb-01cef4f0022f (59f58f5e-c4f8-494d-92fb-01cef4f0022f): created successfully Jul 08 14:30:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41a6d95a-2b0c-4e48-8549-64e526f67d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Flow 'volume_create_manager' (7d8c3f0c-35f7-4530-90a9-e41d4d714950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:20 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-622f5b35-a45f-482c-a70b-225d41d80121 tempest-ServersNegativeTestJSON-748290206 None] Created volume successfully. Jul 08 14:30:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-14d53780-860c-4c54-9419-c99ce2bf8563 req-5264e5ef-f4cd-47e3-9588-ff70510798f6 tempest-AttachVolumeShelveTestJSON-151046349 None] No connector for attachment c9fcc690-de94-4a8a-9cff-8b59c4559097; skipping storage backend terminate_connection call. {{(pid=87240) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 08 14:30:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-14d53780-860c-4c54-9419-c99ce2bf8563 req-5264e5ef-f4cd-47e3-9588-ff70510798f6 tempest-AttachVolumeShelveTestJSON-151046349 None] Deleting attachment c9fcc690-de94-4a8a-9cff-8b59c4559097. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:30:23 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:30:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Flow 'volume_create_manager' (0c79ce08-bbfa-4c4b-a100-2ac6fcf06a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b4a9b68-320d-4533-8649-e1240caf6ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b4a9b68-320d-4533-8649-e1240caf6ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-83464456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70108b44a70a4fee9e90817df729ed7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:23Z,use_quota=True,user_id='31fdf0ffe99e48d3b9ae07e7abeca861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3efd97f2-8df0-498d-abc9-07b18d11680a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3efd97f2-8df0-498d-abc9-07b18d11680a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7fc359-851a-4946-be59-ba89520df66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb7fc359-851a-4946-be59-ba89520df66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d', 'volume_name': 'volume-21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf40d27-8112-4605-9c89-c7b29ddef155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaf40d27-8112-4605-9c89-c7b29ddef155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99864de0-5352-49b3-9356-792d64808311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:23 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Volume 21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d', 'volume_size': 1} Jul 08 14:30:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-83464456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70108b44a70a4fee9e90817df729ed7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:23Z,use_quota=True,user_id='31fdf0ffe99e48d3b9ae07e7abeca861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:30:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Creating volume 21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:30:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:30:23 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:30:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:23 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d 1073741824 Jul 08 14:30:23 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:24 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d 1073741824" returned: 0 in 1.126s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:24 devstack sudo[90808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d Jul 08 14:30:24 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:25 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d" returned: 0 in 0.816s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] <== create_volume: return (2001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:30:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.004s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99864de0-5352-49b3-9356-792d64808311) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792d59ee-dda0-4874-b4c9-04e7e93cebaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:25 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Volume volume-21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d (21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d): created successfully Jul 08 14:30:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (792d59ee-dda0-4874-b4c9-04e7e93cebaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Flow 'volume_create_manager' (0c79ce08-bbfa-4c4b-a100-2ac6fcf06a17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:25 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7244bdad-ba8a-42f4-b5e5-9a973c6610fb tempest-ServersNegativeTestJSON-748290206 None] Created volume successfully. Jul 08 14:30:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-21158fcf-91e1-42a0-9d49-9565744fbb43 tempest-ServersNegativeTestJSON-748290206 None] Acquiring lock "cinder-21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:30:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-21158fcf-91e1-42a0-9d49-9565744fbb43 tempest-ServersNegativeTestJSON-748290206 None] Lock "cinder-21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:30:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-21158fcf-91e1-42a0-9d49-9565744fbb43 tempest-ServersNegativeTestJSON-748290206 None] Acquiring lock "cinder-quobyte-21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:30:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-21158fcf-91e1-42a0-9d49-9565744fbb43 tempest-ServersNegativeTestJSON-748290206 None] Lock "cinder-quobyte-21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d" acquired by "delete_volume" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:30:27 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4311792-44e3-4ff7-8c7f-10812cb16101]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:30:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-21158fcf-91e1-42a0-9d49-9565744fbb43 tempest-ServersNegativeTestJSON-748290206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:27 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d Jul 08 14:30:27 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:27 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-21158fcf-91e1-42a0-9d49-9565744fbb43 tempest-ServersNegativeTestJSON-748290206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d" returned: 0 in 0.871s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-21158fcf-91e1-42a0-9d49-9565744fbb43 tempest-ServersNegativeTestJSON-748290206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:27 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d Jul 08 14:30:27 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:28 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-21158fcf-91e1-42a0-9d49-9565744fbb43 tempest-ServersNegativeTestJSON-748290206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d" returned: 0 in 0.795s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-21158fcf-91e1-42a0-9d49-9565744fbb43 tempest-ServersNegativeTestJSON-748290206 None] Lock "cinder-quobyte-21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d" released by "delete_volume" :: held 1.753s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:30:28 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-21158fcf-91e1-42a0-9d49-9565744fbb43 tempest-ServersNegativeTestJSON-748290206 None] Created reservations ['50f26431-763b-4c3f-9b75-64066043b869', '9b759327-8c5c-4847-82c2-8b0f21924b85', '08468c2a-9369-4a73-b510-82adb0c308b2', 'b9aac000-527e-42bf-b039-db3172fa11e1'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:30:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-21158fcf-91e1-42a0-9d49-9565744fbb43 tempest-ServersNegativeTestJSON-748290206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-21158fcf-91e1-42a0-9d49-9565744fbb43 tempest-ServersNegativeTestJSON-748290206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-21158fcf-91e1-42a0-9d49-9565744fbb43 tempest-ServersNegativeTestJSON-748290206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-21158fcf-91e1-42a0-9d49-9565744fbb43 tempest-ServersNegativeTestJSON-748290206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-21158fcf-91e1-42a0-9d49-9565744fbb43 tempest-ServersNegativeTestJSON-748290206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-21158fcf-91e1-42a0-9d49-9565744fbb43 tempest-ServersNegativeTestJSON-748290206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:28 devstack sudo[90820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:30:28 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5b1470dd-ba2c-41d0-ae24-a1c209f4df36 tempest-ServersNegativeTestJSON-748290206 None] Acquiring lock "cinder-59f58f5e-c4f8-494d-92fb-01cef4f0022f-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:30:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5b1470dd-ba2c-41d0-ae24-a1c209f4df36 tempest-ServersNegativeTestJSON-748290206 None] Lock "cinder-59f58f5e-c4f8-494d-92fb-01cef4f0022f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:30:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5b1470dd-ba2c-41d0-ae24-a1c209f4df36 tempest-ServersNegativeTestJSON-748290206 None] Acquiring lock "cinder-quobyte-59f58f5e-c4f8-494d-92fb-01cef4f0022f" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:30:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5b1470dd-ba2c-41d0-ae24-a1c209f4df36 tempest-ServersNegativeTestJSON-748290206 None] Lock "cinder-quobyte-59f58f5e-c4f8-494d-92fb-01cef4f0022f" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:30:29 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc92458-68c5-41a2-a543-3edd64fd8c63]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:30:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b1470dd-ba2c-41d0-ae24-a1c209f4df36 tempest-ServersNegativeTestJSON-748290206 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59f58f5e-c4f8-494d-92fb-01cef4f0022f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:29 devstack sudo[90823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59f58f5e-c4f8-494d-92fb-01cef4f0022f Jul 08 14:30:29 devstack sudo[90823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:29 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-21158fcf-91e1-42a0-9d49-9565744fbb43 tempest-ServersNegativeTestJSON-748290206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.974s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:29 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-21158fcf-91e1-42a0-9d49-9565744fbb43 tempest-ServersNegativeTestJSON-748290206 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:30:29 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-21158fcf-91e1-42a0-9d49-9565744fbb43 tempest-ServersNegativeTestJSON-748290206 None] Deleted volume successfully. Jul 08 14:30:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-21158fcf-91e1-42a0-9d49-9565744fbb43 tempest-ServersNegativeTestJSON-748290206 None] Lock "cinder-21b203b1-2c7c-4ddc-bc4f-f2e8ef317c2d-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:30:30 devstack sudo[90823]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b1470dd-ba2c-41d0-ae24-a1c209f4df36 tempest-ServersNegativeTestJSON-748290206 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59f58f5e-c4f8-494d-92fb-01cef4f0022f" returned: 0 in 1.166s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b1470dd-ba2c-41d0-ae24-a1c209f4df36 tempest-ServersNegativeTestJSON-748290206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59f58f5e-c4f8-494d-92fb-01cef4f0022f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:30 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59f58f5e-c4f8-494d-92fb-01cef4f0022f Jul 08 14:30:30 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:31 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b1470dd-ba2c-41d0-ae24-a1c209f4df36 tempest-ServersNegativeTestJSON-748290206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59f58f5e-c4f8-494d-92fb-01cef4f0022f" returned: 0 in 1.161s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5b1470dd-ba2c-41d0-ae24-a1c209f4df36 tempest-ServersNegativeTestJSON-748290206 None] Lock "cinder-quobyte-59f58f5e-c4f8-494d-92fb-01cef4f0022f" released by "delete_volume" :: held 2.392s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:30:31 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-5b1470dd-ba2c-41d0-ae24-a1c209f4df36 tempest-ServersNegativeTestJSON-748290206 None] Created reservations ['46e50a90-0444-4087-bd19-963ff3666bf4', '496fca55-fdac-458a-8ae4-d8a8b14033fe', '3f6b6b71-b670-474c-8c97-9c54b0d36773', 'ef23136b-d0cb-40fe-83a2-3d848bbc46be'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:30:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5b1470dd-ba2c-41d0-ae24-a1c209f4df36 tempest-ServersNegativeTestJSON-748290206 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5b1470dd-ba2c-41d0-ae24-a1c209f4df36 tempest-ServersNegativeTestJSON-748290206 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5b1470dd-ba2c-41d0-ae24-a1c209f4df36 tempest-ServersNegativeTestJSON-748290206 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5b1470dd-ba2c-41d0-ae24-a1c209f4df36 tempest-ServersNegativeTestJSON-748290206 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5b1470dd-ba2c-41d0-ae24-a1c209f4df36 tempest-ServersNegativeTestJSON-748290206 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b1470dd-ba2c-41d0-ae24-a1c209f4df36 tempest-ServersNegativeTestJSON-748290206 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:32 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:30:32 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:32 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b1470dd-ba2c-41d0-ae24-a1c209f4df36 tempest-ServersNegativeTestJSON-748290206 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.775s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:32 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-5b1470dd-ba2c-41d0-ae24-a1c209f4df36 tempest-ServersNegativeTestJSON-748290206 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:30:32 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5b1470dd-ba2c-41d0-ae24-a1c209f4df36 tempest-ServersNegativeTestJSON-748290206 None] Deleted volume successfully. Jul 08 14:30:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5b1470dd-ba2c-41d0-ae24-a1c209f4df36 tempest-ServersNegativeTestJSON-748290206 None] Lock "cinder-59f58f5e-c4f8-494d-92fb-01cef4f0022f-delete_volume" released by "delete_volume" :: held 3.463s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:30:35 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:30:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Flow 'volume_create_manager' (6e109eb0-e032-4fac-b6be-23d5b087fe18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22fad699-52cf-4348-ae5d-febcd748ed35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22fad699-52cf-4348-ae5d-febcd748ed35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-359326163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb585dc1-2d21-4692-bef0-4167c6b1765b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e34a94e06d64730b218b1f83a7a8b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:36Z,use_quota=True,user_id='b967a49744ed4a9fafd1dcd92176b0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (096f373c-c1c0-4768-8113-9a6c27ea8075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (096f373c-c1c0-4768-8113-9a6c27ea8075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c2823b-19d2-453c-abe1-f1aae2697f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c2823b-19d2-453c-abe1-f1aae2697f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb585dc1-2d21-4692-bef0-4167c6b1765b', 'volume_name': 'volume-bb585dc1-2d21-4692-bef0-4167c6b1765b', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b388f9fb-ffc1-425a-a494-a49c5586e811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b388f9fb-ffc1-425a-a494-a49c5586e811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492b530c-17b7-4ce8-9dd4-93066fae2ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:36 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Volume bb585dc1-2d21-4692-bef0-4167c6b1765b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb585dc1-2d21-4692-bef0-4167c6b1765b', 'volume_size': 1} Jul 08 14:30:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-359326163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb585dc1-2d21-4692-bef0-4167c6b1765b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e34a94e06d64730b218b1f83a7a8b9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:30:36Z,use_quota=True,user_id='b967a49744ed4a9fafd1dcd92176b0c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:30:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Creating volume bb585dc1-2d21-4692-bef0-4167c6b1765b {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:30:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:30:36 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:30:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bb585dc1-2d21-4692-bef0-4167c6b1765b 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:36 devstack sudo[91392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bb585dc1-2d21-4692-bef0-4167c6b1765b 1073741824 Jul 08 14:30:36 devstack sudo[91392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:37 devstack sudo[91392]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bb585dc1-2d21-4692-bef0-4167c6b1765b 1073741824" returned: 0 in 1.778s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bb585dc1-2d21-4692-bef0-4167c6b1765b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:38 devstack sudo[91428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bb585dc1-2d21-4692-bef0-4167c6b1765b Jul 08 14:30:38 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:30:39 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root Jul 08 14:30:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bb585dc1-2d21-4692-bef0-4167c6b1765b" returned: 0 in 1.637s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:30:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] <== create_volume: return (3539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:30:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.545s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (492b530c-17b7-4ce8-9dd4-93066fae2ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb585dc1-2d21-4692-bef0-4167c6b1765b', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65053e7f-39dc-4f20-8dcc-499e562276d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:30:39 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Volume volume-bb585dc1-2d21-4692-bef0-4167c6b1765b (bb585dc1-2d21-4692-bef0-4167c6b1765b): created successfully Jul 08 14:30:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65053e7f-39dc-4f20-8dcc-499e562276d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:30:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Flow 'volume_create_manager' (6e109eb0-e032-4fac-b6be-23d5b087fe18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:30:39 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-283016d8-a344-4bb6-8b3c-9f5ba6bb4e94 tempest-ServerActionsTestOtherA-1815051181 None] Created volume successfully. Jul 08 14:30:49 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=24,cinder:UPDATE=29,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:30:49 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=25,cinder:UPDATE=30,cinder:INSERT=7,cinder:DELETE=4 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:30:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-15967c9c-a798-48bd-8c5f-2b257f1bde7d tempest-BackendsCapabilitiesAdminTestsJSON-856774450 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.744213104248, 'free_capacity_gb': 1775.744213104248, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87240) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 14:30:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-03e7ce67-4508-43af-855f-e1e075f6b2a0 tempest-BackendsCapabilitiesAdminTestsJSON-856774450 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.744213104248, 'free_capacity_gb': 1775.744213104248, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87240) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 14:30:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:30:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:30:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:30:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:30:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:30:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:30:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:30:59 devstack sudo[91641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:30:59 devstack sudo[91641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:00 devstack sudo[91641]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.661s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:31:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:31:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 8 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:31:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:31:04 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-431dcf11-caa0-4763-8c54-ff71845cc892 req-5453b631-26f5-4696-b894-c0fb46baa3a1 tempest-AttachVolumeTestJSON-723745895 None] Terminate volume connection completed successfully. Jul 08 14:31:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-431dcf11-caa0-4763-8c54-ff71845cc892 req-5453b631-26f5-4696-b894-c0fb46baa3a1 tempest-AttachVolumeTestJSON-723745895 None] Deleting attachment 2cb0ac5b-9760-422f-a66c-5638a924f3e7. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:31:14 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=2 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:31:24 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:31:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Flow 'volume_create_manager' (4ad4429b-3bea-4bd9-a331-44211594f6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:31:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a73363-f972-4c06-ad1d-15e00a33ce7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a73363-f972-4c06-ad1d-15e00a33ce7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1934476535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bb1cc33-5fd4-4d58-9362-848c1c9dd26f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae1d2f8ed334cf6a50864e2ab8f19f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:31:25Z,use_quota=True,user_id='f3ef7d022ace4e139a934d162071434a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa37dfac-79ae-4470-a987-17452287bf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa37dfac-79ae-4470-a987-17452287bf8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19070c9d-5484-4486-a06e-5d121d61210f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19070c9d-5484-4486-a06e-5d121d61210f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bb1cc33-5fd4-4d58-9362-848c1c9dd26f', 'volume_name': 'volume-6bb1cc33-5fd4-4d58-9362-848c1c9dd26f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f0bf89-05d3-430d-b44d-8fab9d457d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f0bf89-05d3-430d-b44d-8fab9d457d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bacf0f-3c16-420d-892d-0ffdad411947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:24 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Volume 6bb1cc33-5fd4-4d58-9362-848c1c9dd26f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bb1cc33-5fd4-4d58-9362-848c1c9dd26f', 'volume_size': 1} Jul 08 14:31:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1934476535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bb1cc33-5fd4-4d58-9362-848c1c9dd26f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bae1d2f8ed334cf6a50864e2ab8f19f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:31:25Z,use_quota=True,user_id='f3ef7d022ace4e139a934d162071434a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:31:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Creating volume 6bb1cc33-5fd4-4d58-9362-848c1c9dd26f {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:31:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:31:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:31:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:31:24 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:31:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6bb1cc33-5fd4-4d58-9362-848c1c9dd26f 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:24 devstack sudo[91798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6bb1cc33-5fd4-4d58-9362-848c1c9dd26f 1073741824 Jul 08 14:31:24 devstack sudo[91798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:25 devstack sudo[91798]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6bb1cc33-5fd4-4d58-9362-848c1c9dd26f 1073741824" returned: 0 in 1.163s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6bb1cc33-5fd4-4d58-9362-848c1c9dd26f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:25 devstack sudo[91805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6bb1cc33-5fd4-4d58-9362-848c1c9dd26f Jul 08 14:31:25 devstack sudo[91805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:26 devstack sudo[91805]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6bb1cc33-5fd4-4d58-9362-848c1c9dd26f" returned: 0 in 0.881s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] <== create_volume: return (2140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:31:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.150s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24bacf0f-3c16-420d-892d-0ffdad411947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bb1cc33-5fd4-4d58-9362-848c1c9dd26f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9059d18c-99ba-4988-a7bc-c6d76ace1133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:26 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Volume volume-6bb1cc33-5fd4-4d58-9362-848c1c9dd26f (6bb1cc33-5fd4-4d58-9362-848c1c9dd26f): created successfully Jul 08 14:31:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9059d18c-99ba-4988-a7bc-c6d76ace1133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Flow 'volume_create_manager' (4ad4429b-3bea-4bd9-a331-44211594f6e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:31:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-dff012d6-af11-430a-9965-63949d06afe5 tempest-VolumesServicesTestJSON-2106920095 None] Created volume successfully. Jul 08 14:31:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e4e9676f-5cce-483e-9694-76f5697025c3 tempest-VolumesServicesTestJSON-2106920095 None] Acquiring lock "cinder-6bb1cc33-5fd4-4d58-9362-848c1c9dd26f-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:31:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e4e9676f-5cce-483e-9694-76f5697025c3 tempest-VolumesServicesTestJSON-2106920095 None] Lock "cinder-6bb1cc33-5fd4-4d58-9362-848c1c9dd26f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:31:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e4e9676f-5cce-483e-9694-76f5697025c3 tempest-VolumesServicesTestJSON-2106920095 None] Acquiring lock "cinder-quobyte-6bb1cc33-5fd4-4d58-9362-848c1c9dd26f" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:31:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e4e9676f-5cce-483e-9694-76f5697025c3 tempest-VolumesServicesTestJSON-2106920095 None] Lock "cinder-quobyte-6bb1cc33-5fd4-4d58-9362-848c1c9dd26f" acquired by "delete_volume" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:31:28 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03fb080-9bbc-4b4a-a017-0fdfa3b37c73]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:31:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e4e9676f-5cce-483e-9694-76f5697025c3 tempest-VolumesServicesTestJSON-2106920095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6bb1cc33-5fd4-4d58-9362-848c1c9dd26f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:28 devstack sudo[91837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6bb1cc33-5fd4-4d58-9362-848c1c9dd26f Jul 08 14:31:28 devstack sudo[91837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:29 devstack sudo[91837]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e4e9676f-5cce-483e-9694-76f5697025c3 tempest-VolumesServicesTestJSON-2106920095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6bb1cc33-5fd4-4d58-9362-848c1c9dd26f" returned: 0 in 0.936s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e4e9676f-5cce-483e-9694-76f5697025c3 tempest-VolumesServicesTestJSON-2106920095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6bb1cc33-5fd4-4d58-9362-848c1c9dd26f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:29 devstack sudo[91844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6bb1cc33-5fd4-4d58-9362-848c1c9dd26f Jul 08 14:31:29 devstack sudo[91844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:29 devstack sudo[91844]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e4e9676f-5cce-483e-9694-76f5697025c3 tempest-VolumesServicesTestJSON-2106920095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6bb1cc33-5fd4-4d58-9362-848c1c9dd26f" returned: 0 in 0.766s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e4e9676f-5cce-483e-9694-76f5697025c3 tempest-VolumesServicesTestJSON-2106920095 None] Lock "cinder-quobyte-6bb1cc33-5fd4-4d58-9362-848c1c9dd26f" released by "delete_volume" :: held 1.767s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:31:29 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-e4e9676f-5cce-483e-9694-76f5697025c3 tempest-VolumesServicesTestJSON-2106920095 None] Created reservations ['64b625b7-bddd-4c0e-bb8d-5dd180399e89', '4a30493c-804d-4613-bc75-f8922ba14c64', 'f9fb49ff-d05f-497f-858a-97f6f9bab5b1', 'a6f7d02a-9ce8-4854-b5dd-3b3d2bff1158'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:31:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e4e9676f-5cce-483e-9694-76f5697025c3 tempest-VolumesServicesTestJSON-2106920095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e4e9676f-5cce-483e-9694-76f5697025c3 tempest-VolumesServicesTestJSON-2106920095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e4e9676f-5cce-483e-9694-76f5697025c3 tempest-VolumesServicesTestJSON-2106920095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:31:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e4e9676f-5cce-483e-9694-76f5697025c3 tempest-VolumesServicesTestJSON-2106920095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:31:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e4e9676f-5cce-483e-9694-76f5697025c3 tempest-VolumesServicesTestJSON-2106920095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e4e9676f-5cce-483e-9694-76f5697025c3 tempest-VolumesServicesTestJSON-2106920095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:30 devstack sudo[91848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:31:30 devstack sudo[91848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-d6be21b0-a39a-4015-a3f0-723c605f8dbf req-d258c5b8-3a61-4cea-b89b-0a26ab0cc148 tempest-ServerActionsTestOtherA-1815051181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-d6be21b0-a39a-4015-a3f0-723c605f8dbf req-d258c5b8-3a61-4cea-b89b-0a26ab0cc148 tempest-ServerActionsTestOtherA-1815051181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:30 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[299ab23c-269b-4c34-a95a-7826d340c865]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:31:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-d6be21b0-a39a-4015-a3f0-723c605f8dbf req-d258c5b8-3a61-4cea-b89b-0a26ab0cc148 tempest-ServerActionsTestOtherA-1815051181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bb585dc1-2d21-4692-bef0-4167c6b1765b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:30 devstack sudo[91872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bb585dc1-2d21-4692-bef0-4167c6b1765b Jul 08 14:31:30 devstack sudo[91872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:30 devstack sudo[91848]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e4e9676f-5cce-483e-9694-76f5697025c3 tempest-VolumesServicesTestJSON-2106920095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.811s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:30 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-e4e9676f-5cce-483e-9694-76f5697025c3 tempest-VolumesServicesTestJSON-2106920095 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:31:30 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e4e9676f-5cce-483e-9694-76f5697025c3 tempest-VolumesServicesTestJSON-2106920095 None] Deleted volume successfully. Jul 08 14:31:30 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e4e9676f-5cce-483e-9694-76f5697025c3 tempest-VolumesServicesTestJSON-2106920095 None] Lock "cinder-6bb1cc33-5fd4-4d58-9362-848c1c9dd26f-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:31:31 devstack sudo[91872]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-d6be21b0-a39a-4015-a3f0-723c605f8dbf req-d258c5b8-3a61-4cea-b89b-0a26ab0cc148 tempest-ServerActionsTestOtherA-1815051181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bb585dc1-2d21-4692-bef0-4167c6b1765b" returned: 0 in 1.213s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-d6be21b0-a39a-4015-a3f0-723c605f8dbf req-d258c5b8-3a61-4cea-b89b-0a26ab0cc148 tempest-ServerActionsTestOtherA-1815051181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.244s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-d6be21b0-a39a-4015-a3f0-723c605f8dbf req-d258c5b8-3a61-4cea-b89b-0a26ab0cc148 tempest-ServerActionsTestOtherA-1815051181 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad', 'name': 'volume-bb585dc1-2d21-4692-bef0-4167c6b1765b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b6076263-6b46-4cf1-9ba3-552bd2b7c894', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:31:31 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-d6be21b0-a39a-4015-a3f0-723c605f8dbf req-d258c5b8-3a61-4cea-b89b-0a26ab0cc148 tempest-ServerActionsTestOtherA-1815051181 None] attachment_update completed successfully. Jul 08 14:31:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b444a660-806c-48ba-8791-e7a0d1d7c9ff tempest-AttachVolumeShelveTestJSON-151046349 None] Acquiring lock "cinder-4af1eb44-7ceb-4194-8901-8747fe3f446d-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:31:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b444a660-806c-48ba-8791-e7a0d1d7c9ff tempest-AttachVolumeShelveTestJSON-151046349 None] Lock "cinder-4af1eb44-7ceb-4194-8901-8747fe3f446d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:31:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b444a660-806c-48ba-8791-e7a0d1d7c9ff tempest-AttachVolumeShelveTestJSON-151046349 None] Acquiring lock "cinder-quobyte-4af1eb44-7ceb-4194-8901-8747fe3f446d" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:31:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b444a660-806c-48ba-8791-e7a0d1d7c9ff tempest-AttachVolumeShelveTestJSON-151046349 None] Lock "cinder-quobyte-4af1eb44-7ceb-4194-8901-8747fe3f446d" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:31:34 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4882df-7624-4b4d-a888-07657b07c6fe]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:31:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b444a660-806c-48ba-8791-e7a0d1d7c9ff tempest-AttachVolumeShelveTestJSON-151046349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4af1eb44-7ceb-4194-8901-8747fe3f446d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:34 devstack sudo[92261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4af1eb44-7ceb-4194-8901-8747fe3f446d Jul 08 14:31:34 devstack sudo[92261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:35 devstack sudo[92261]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b444a660-806c-48ba-8791-e7a0d1d7c9ff tempest-AttachVolumeShelveTestJSON-151046349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4af1eb44-7ceb-4194-8901-8747fe3f446d" returned: 0 in 0.937s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b444a660-806c-48ba-8791-e7a0d1d7c9ff tempest-AttachVolumeShelveTestJSON-151046349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4af1eb44-7ceb-4194-8901-8747fe3f446d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:35 devstack sudo[92266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4af1eb44-7ceb-4194-8901-8747fe3f446d Jul 08 14:31:35 devstack sudo[92266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:36 devstack sudo[92266]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b444a660-806c-48ba-8791-e7a0d1d7c9ff tempest-AttachVolumeShelveTestJSON-151046349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4af1eb44-7ceb-4194-8901-8747fe3f446d" returned: 0 in 0.826s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b444a660-806c-48ba-8791-e7a0d1d7c9ff tempest-AttachVolumeShelveTestJSON-151046349 None] Lock "cinder-quobyte-4af1eb44-7ceb-4194-8901-8747fe3f446d" released by "delete_volume" :: held 1.839s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:31:36 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-b444a660-806c-48ba-8791-e7a0d1d7c9ff tempest-AttachVolumeShelveTestJSON-151046349 None] Created reservations ['f07efdcb-8214-490d-9bd1-6ce2bfe50c6b', 'b6944e6f-dc3a-4e51-a6c9-a8b14c1c54ce', '8d9bfa17-43c0-44bc-b598-55d933c0df62', '6451be2b-9dcc-44cb-8f54-0d3a28cca80c'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:31:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b444a660-806c-48ba-8791-e7a0d1d7c9ff tempest-AttachVolumeShelveTestJSON-151046349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b444a660-806c-48ba-8791-e7a0d1d7c9ff tempest-AttachVolumeShelveTestJSON-151046349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b444a660-806c-48ba-8791-e7a0d1d7c9ff tempest-AttachVolumeShelveTestJSON-151046349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:31:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b444a660-806c-48ba-8791-e7a0d1d7c9ff tempest-AttachVolumeShelveTestJSON-151046349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:31:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b444a660-806c-48ba-8791-e7a0d1d7c9ff tempest-AttachVolumeShelveTestJSON-151046349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b444a660-806c-48ba-8791-e7a0d1d7c9ff tempest-AttachVolumeShelveTestJSON-151046349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:36 devstack sudo[92269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:31:36 devstack sudo[92269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:37 devstack sudo[92269]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b444a660-806c-48ba-8791-e7a0d1d7c9ff tempest-AttachVolumeShelveTestJSON-151046349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.155s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:37 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-b444a660-806c-48ba-8791-e7a0d1d7c9ff tempest-AttachVolumeShelveTestJSON-151046349 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:31:37 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b444a660-806c-48ba-8791-e7a0d1d7c9ff tempest-AttachVolumeShelveTestJSON-151046349 None] Deleted volume successfully. Jul 08 14:31:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b444a660-806c-48ba-8791-e7a0d1d7c9ff tempest-AttachVolumeShelveTestJSON-151046349 None] Lock "cinder-4af1eb44-7ceb-4194-8901-8747fe3f446d-delete_volume" released by "delete_volume" :: held 3.358s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:31:41 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-1b1d2024-f9a8-4886-8835-935cb9f3fcf1 req-e46d9c23-1f31-4a99-9405-43fb1c4cdb1a tempest-ServerActionsTestOtherA-1815051181 None] Terminate volume connection completed successfully. Jul 08 14:31:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-1b1d2024-f9a8-4886-8835-935cb9f3fcf1 req-e46d9c23-1f31-4a99-9405-43fb1c4cdb1a tempest-ServerActionsTestOtherA-1815051181 None] Deleting attachment b6076263-6b46-4cf1-9ba3-552bd2b7c894. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:31:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-1b1d2024-f9a8-4886-8835-935cb9f3fcf1 req-518374af-ba72-429f-a3f7-63c1cc2700a4 tempest-ServerActionsTestOtherA-1815051181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-1b1d2024-f9a8-4886-8835-935cb9f3fcf1 req-518374af-ba72-429f-a3f7-63c1cc2700a4 tempest-ServerActionsTestOtherA-1815051181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[218b36d4-123f-42a3-8e9b-e9eeca549e20]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:31:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-1b1d2024-f9a8-4886-8835-935cb9f3fcf1 req-518374af-ba72-429f-a3f7-63c1cc2700a4 tempest-ServerActionsTestOtherA-1815051181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bb585dc1-2d21-4692-bef0-4167c6b1765b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:44 devstack sudo[92395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bb585dc1-2d21-4692-bef0-4167c6b1765b Jul 08 14:31:44 devstack sudo[92395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:45 devstack sudo[92395]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-1b1d2024-f9a8-4886-8835-935cb9f3fcf1 req-518374af-ba72-429f-a3f7-63c1cc2700a4 tempest-ServerActionsTestOtherA-1815051181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bb585dc1-2d21-4692-bef0-4167c6b1765b" returned: 0 in 1.352s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-1b1d2024-f9a8-4886-8835-935cb9f3fcf1 req-518374af-ba72-429f-a3f7-63c1cc2700a4 tempest-ServerActionsTestOtherA-1815051181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.376s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-1b1d2024-f9a8-4886-8835-935cb9f3fcf1 req-518374af-ba72-429f-a3f7-63c1cc2700a4 tempest-ServerActionsTestOtherA-1815051181 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad', 'name': 'volume-bb585dc1-2d21-4692-bef0-4167c6b1765b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2596cb19-d205-4f0a-981e-e38d3f1dc995', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:31:45 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-1b1d2024-f9a8-4886-8835-935cb9f3fcf1 req-518374af-ba72-429f-a3f7-63c1cc2700a4 tempest-ServerActionsTestOtherA-1815051181 None] attachment_update completed successfully. Jul 08 14:31:46 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:31:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Flow 'volume_create_manager' (f934e506-7e31-4256-b2d8-59a6ea708123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:31:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2a2c6a-28e2-4e85-8cc7-4d6e86aa2282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f2a2c6a-28e2-4e85-8cc7-4d6e86aa2282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-650398491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8269ae88-0fe1-4d68-8dda-f4eac1bfd91e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0221d5774f6c4d4d9c79494bbdaa76eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:31:47Z,use_quota=True,user_id='06be5766650d46679ea798e1a49a7d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (992a423d-7cea-4fce-9a81-96ee2abd6930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (992a423d-7cea-4fce-9a81-96ee2abd6930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c914f0a-ea43-4e6c-b507-536456ac7976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c914f0a-ea43-4e6c-b507-536456ac7976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8269ae88-0fe1-4d68-8dda-f4eac1bfd91e', 'volume_name': 'volume-8269ae88-0fe1-4d68-8dda-f4eac1bfd91e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ecd810-e27f-4647-9941-7afe9dea869f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9ecd810-e27f-4647-9941-7afe9dea869f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057043df-918b-40fe-a2ee-56ae806a43b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:47 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Volume 8269ae88-0fe1-4d68-8dda-f4eac1bfd91e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8269ae88-0fe1-4d68-8dda-f4eac1bfd91e', 'volume_size': 1} Jul 08 14:31:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-650398491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8269ae88-0fe1-4d68-8dda-f4eac1bfd91e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0221d5774f6c4d4d9c79494bbdaa76eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:31:47Z,use_quota=True,user_id='06be5766650d46679ea798e1a49a7d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:31:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Creating volume 8269ae88-0fe1-4d68-8dda-f4eac1bfd91e {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:31:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:31:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:31:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:31:47 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:31:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8269ae88-0fe1-4d68-8dda-f4eac1bfd91e 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:47 devstack sudo[92413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8269ae88-0fe1-4d68-8dda-f4eac1bfd91e 1073741824 Jul 08 14:31:47 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:48 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8269ae88-0fe1-4d68-8dda-f4eac1bfd91e 1073741824" returned: 0 in 1.119s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8269ae88-0fe1-4d68-8dda-f4eac1bfd91e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:48 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8269ae88-0fe1-4d68-8dda-f4eac1bfd91e Jul 08 14:31:48 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:48 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:31:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Flow 'volume_create_manager' (9b7cf617-72fe-4c67-89e7-a66748df98c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:31:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec480469-be2e-413f-9f33-fa96d603ed80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec480469-be2e-413f-9f33-fa96d603ed80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-164961750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d296caf1-8201-4a0c-90c9-14e0c1d83b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dc9a2eb1f6e40949d29e5d4e38ff5ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:31:49Z,use_quota=True,user_id='b53bf2e8b00f400989cfbd47d48aecb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d47ada2-e15a-4c69-b031-1d86528440e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d47ada2-e15a-4c69-b031-1d86528440e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602ca170-182e-484b-86a3-6c1c3decb62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (602ca170-182e-484b-86a3-6c1c3decb62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd296caf1-8201-4a0c-90c9-14e0c1d83b6d', 'volume_name': 'volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2279aee7-d7b2-46c6-adcd-794f5de4c17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2279aee7-d7b2-46c6-adcd-794f5de4c17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3acafab7-568a-44fa-b445-9550e3812c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:48 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Volume d296caf1-8201-4a0c-90c9-14e0c1d83b6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d', 'volume_size': 1} Jul 08 14:31:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:49 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8269ae88-0fe1-4d68-8dda-f4eac1bfd91e" returned: 0 in 0.949s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] <== create_volume: return (2168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:31:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.171s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.395s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-164961750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d296caf1-8201-4a0c-90c9-14e0c1d83b6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dc9a2eb1f6e40949d29e5d4e38ff5ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:31:49Z,use_quota=True,user_id='b53bf2e8b00f400989cfbd47d48aecb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:31:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Creating volume d296caf1-8201-4a0c-90c9-14e0c1d83b6d {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:31:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:31:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:31:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:31:49 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:31:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057043df-918b-40fe-a2ee-56ae806a43b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8269ae88-0fe1-4d68-8dda-f4eac1bfd91e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:49 devstack sudo[92438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d 1073741824 Jul 08 14:31:49 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c56dcb-403d-43d4-abe4-6f4716ab4cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:49 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Volume volume-8269ae88-0fe1-4d68-8dda-f4eac1bfd91e (8269ae88-0fe1-4d68-8dda-f4eac1bfd91e): created successfully Jul 08 14:31:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8c56dcb-403d-43d4-abe4-6f4716ab4cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Flow 'volume_create_manager' (f934e506-7e31-4256-b2d8-59a6ea708123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:31:49 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-de817ec4-2a60-4a17-9c0c-1e3379363976 tempest-VolumesListAdminTestJSON-1758118590 None] Created volume successfully. Jul 08 14:31:50 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d 1073741824" returned: 0 in 1.059s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:50 devstack sudo[92525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d Jul 08 14:31:50 devstack sudo[92525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Flow 'volume_create_manager' (bc3667f7-ec9a-4b12-8b12-3e292f11a530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e070f1-d80f-4c55-9bf5-9540b2bc4ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e070f1-d80f-4c55-9bf5-9540b2bc4ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1159926179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2423b0-300a-40e2-abbd-42c240da3a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0221d5774f6c4d4d9c79494bbdaa76eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:31:51Z,use_quota=True,user_id='06be5766650d46679ea798e1a49a7d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc0608e-b272-481e-bfca-f913ce5b5cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bc0608e-b272-481e-bfca-f913ce5b5cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62967dda-8ece-444c-812d-acd4584e09be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62967dda-8ece-444c-812d-acd4584e09be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d2423b0-300a-40e2-abbd-42c240da3a27', 'volume_name': 'volume-2d2423b0-300a-40e2-abbd-42c240da3a27', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b8c3bd-fd3a-4dc2-a666-151861d0fa5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b8c3bd-fd3a-4dc2-a666-151861d0fa5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6793e869-3d8b-4ced-a657-52b95f81542c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:51 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Volume 2d2423b0-300a-40e2-abbd-42c240da3a27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d2423b0-300a-40e2-abbd-42c240da3a27', 'volume_size': 1} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:51 devstack sudo[92525]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d" returned: 0 in 1.167s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] <== create_volume: return (2346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.349s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.257s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1159926179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d2423b0-300a-40e2-abbd-42c240da3a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0221d5774f6c4d4d9c79494bbdaa76eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:31:51Z,use_quota=True,user_id='06be5766650d46679ea798e1a49a7d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Creating volume 2d2423b0-300a-40e2-abbd-42c240da3a27 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:31:51 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2d2423b0-300a-40e2-abbd-42c240da3a27 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:51 devstack sudo[92541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2d2423b0-300a-40e2-abbd-42c240da3a27 1073741824 Jul 08 14:31:51 devstack sudo[92541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3acafab7-568a-44fa-b445-9550e3812c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acce537b-b3c3-4246-bc96-e3cce3a69141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:51 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Volume volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d (d296caf1-8201-4a0c-90c9-14e0c1d83b6d): created successfully Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acce537b-b3c3-4246-bc96-e3cce3a69141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Flow 'volume_create_manager' (9b7cf617-72fe-4c67-89e7-a66748df98c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:31:51 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-7f2dcf43-cfc4-46b6-9103-258c5dafb4be req-e7b2ed1e-d2dc-4002-b0d0-0369775a722a tempest-VolumesSnapshotsTestJSON-1241784614 None] Created volume successfully. Jul 08 14:31:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-2c63dcf4-dc46-41bd-b420-34b3327bc3e9 req-c68a66c3-2a78-4abe-a9de-08b86364099b tempest-VolumesSnapshotsTestJSON-1241784614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:53 devstack sudo[92541]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2d2423b0-300a-40e2-abbd-42c240da3a27 1073741824" returned: 0 in 1.437s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2d2423b0-300a-40e2-abbd-42c240da3a27 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:53 devstack sudo[92884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2d2423b0-300a-40e2-abbd-42c240da3a27 Jul 08 14:31:53 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:53 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2d2423b0-300a-40e2-abbd-42c240da3a27" returned: 0 in 0.874s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] <== create_volume: return (2446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:31:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.449s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-2c63dcf4-dc46-41bd-b420-34b3327bc3e9 req-c68a66c3-2a78-4abe-a9de-08b86364099b tempest-VolumesSnapshotsTestJSON-1241784614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.411s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6793e869-3d8b-4ced-a657-52b95f81542c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d2423b0-300a-40e2-abbd-42c240da3a27', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc903c0-64ed-4e2b-9fea-462ab9969d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [req-2c63dcf4-dc46-41bd-b420-34b3327bc3e9 req-c68a66c3-2a78-4abe-a9de-08b86364099b tempest-VolumesSnapshotsTestJSON-1241784614 None] Creating offline snapshot 65aae39a-a322-4566-ac15-9eeff6a74047 of volume d296caf1-8201-4a0c-90c9-14e0c1d83b6d {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:31:54 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Volume volume-2d2423b0-300a-40e2-abbd-42c240da3a27 (2d2423b0-300a-40e2-abbd-42c240da3a27): created successfully Jul 08 14:31:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfc903c0-64ed-4e2b-9fea-462ab9969d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Flow 'volume_create_manager' (bc3667f7-ec9a-4b12-8b12-3e292f11a530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:31:54 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c9b25f-b18a-42d6-8cc7-2a5e9b28d89f]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:31:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-2c63dcf4-dc46-41bd-b420-34b3327bc3e9 req-c68a66c3-2a78-4abe-a9de-08b86364099b tempest-VolumesSnapshotsTestJSON-1241784614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:54 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-eadc8203-3539-4389-a938-41c3fe447583 tempest-VolumesListAdminTestJSON-1758118590 None] Created volume successfully. Jul 08 14:31:54 devstack sudo[92889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d Jul 08 14:31:54 devstack sudo[92889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:55 devstack sudo[92889]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-2c63dcf4-dc46-41bd-b420-34b3327bc3e9 req-c68a66c3-2a78-4abe-a9de-08b86364099b tempest-VolumesSnapshotsTestJSON-1241784614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d" returned: 0 in 1.209s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-2c63dcf4-dc46-41bd-b420-34b3327bc3e9 req-c68a66c3-2a78-4abe-a9de-08b86364099b tempest-VolumesSnapshotsTestJSON-1241784614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.65aae39a-a322-4566-ac15-9eeff6a74047 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:55 devstack sudo[92895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.65aae39a-a322-4566-ac15-9eeff6a74047 1G Jul 08 14:31:55 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:56 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:31:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Flow 'volume_create_manager' (9ad140eb-f422-4ab1-87cd-2b075d9b7a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:31:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c88c3f0-cc1f-480a-af4e-ddfaa8191137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c88c3f0-cc1f-480a-af4e-ddfaa8191137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2134043986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a689af-2e26-4bd0-be39-b27b223d54e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0221d5774f6c4d4d9c79494bbdaa76eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:31:56Z,use_quota=True,user_id='06be5766650d46679ea798e1a49a7d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae404f58-da75-41b4-9d7b-bd87c3158a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae404f58-da75-41b4-9d7b-bd87c3158a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22dc145-d411-4c5f-b1d0-54bbf2295aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22dc145-d411-4c5f-b1d0-54bbf2295aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7a689af-2e26-4bd0-be39-b27b223d54e0', 'volume_name': 'volume-c7a689af-2e26-4bd0-be39-b27b223d54e0', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa14a03-668d-4917-8274-b13c6852ba70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa14a03-668d-4917-8274-b13c6852ba70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:31:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06896110-2d87-4c74-befc-9f26a6fdaab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:31:56 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Volume c7a689af-2e26-4bd0-be39-b27b223d54e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7a689af-2e26-4bd0-be39-b27b223d54e0', 'volume_size': 1} Jul 08 14:31:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:57 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-2c63dcf4-dc46-41bd-b420-34b3327bc3e9 req-c68a66c3-2a78-4abe-a9de-08b86364099b tempest-VolumesSnapshotsTestJSON-1241784614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.65aae39a-a322-4566-ac15-9eeff6a74047 1G" returned: 0 in 1.671s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-2c63dcf4-dc46-41bd-b420-34b3327bc3e9 req-c68a66c3-2a78-4abe-a9de-08b86364099b tempest-VolumesSnapshotsTestJSON-1241784614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.65aae39a-a322-4566-ac15-9eeff6a74047 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:57 devstack sudo[92902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.65aae39a-a322-4566-ac15-9eeff6a74047 Jul 08 14:31:57 devstack sudo[92902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:57 devstack sudo[92902]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-2c63dcf4-dc46-41bd-b420-34b3327bc3e9 req-c68a66c3-2a78-4abe-a9de-08b86364099b tempest-VolumesSnapshotsTestJSON-1241784614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.65aae39a-a322-4566-ac15-9eeff6a74047" returned: 0 in 0.910s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:57 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [req-2c63dcf4-dc46-41bd-b420-34b3327bc3e9 req-c68a66c3-2a78-4abe-a9de-08b86364099b tempest-VolumesSnapshotsTestJSON-1241784614 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.65aae39a-a322-4566-ac15-9eeff6a74047 is being set with open permissions: ugo+rw Jul 08 14:31:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-2c63dcf4-dc46-41bd-b420-34b3327bc3e9 req-c68a66c3-2a78-4abe-a9de-08b86364099b tempest-VolumesSnapshotsTestJSON-1241784614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.65aae39a-a322-4566-ac15-9eeff6a74047 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:57 devstack sudo[92910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.65aae39a-a322-4566-ac15-9eeff6a74047 Jul 08 14:31:57 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:58 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-2c63dcf4-dc46-41bd-b420-34b3327bc3e9 req-c68a66c3-2a78-4abe-a9de-08b86364099b tempest-VolumesSnapshotsTestJSON-1241784614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.65aae39a-a322-4566-ac15-9eeff6a74047" returned: 0 in 0.730s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-2c63dcf4-dc46-41bd-b420-34b3327bc3e9 req-c68a66c3-2a78-4abe-a9de-08b86364099b tempest-VolumesSnapshotsTestJSON-1241784614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:58 devstack sudo[92913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.info Jul 08 14:31:58 devstack sudo[92913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:31:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:31:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:31:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:31:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:31:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:31:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:59 devstack sudo[92916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:31:59 devstack sudo[92916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:31:59 devstack sudo[92913]: pam_unix(sudo:session): session closed for user root Jul 08 14:31:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-2c63dcf4-dc46-41bd-b420-34b3327bc3e9 req-c68a66c3-2a78-4abe-a9de-08b86364099b tempest-VolumesSnapshotsTestJSON-1241784614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.info" returned: 0 in 0.877s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:31:59 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [req-2c63dcf4-dc46-41bd-b420-34b3327bc3e9 req-c68a66c3-2a78-4abe-a9de-08b86364099b tempest-VolumesSnapshotsTestJSON-1241784614 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.info is being set with open permissions: ugo+rw Jul 08 14:31:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-2c63dcf4-dc46-41bd-b420-34b3327bc3e9 req-c68a66c3-2a78-4abe-a9de-08b86364099b tempest-VolumesSnapshotsTestJSON-1241784614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:31:59 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.info Jul 08 14:31:59 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:00 devstack sudo[92916]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.962s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:32:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:32:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 8 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:32:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:32:00 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-2c63dcf4-dc46-41bd-b420-34b3327bc3e9 req-c68a66c3-2a78-4abe-a9de-08b86364099b tempest-VolumesSnapshotsTestJSON-1241784614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.info" returned: 0 in 0.906s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-2c63dcf4-dc46-41bd-b420-34b3327bc3e9 req-c68a66c3-2a78-4abe-a9de-08b86364099b tempest-VolumesSnapshotsTestJSON-1241784614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.511s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.969s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2134043986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7a689af-2e26-4bd0-be39-b27b223d54e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0221d5774f6c4d4d9c79494bbdaa76eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:31:56Z,use_quota=True,user_id='06be5766650d46679ea798e1a49a7d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:32:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Creating volume c7a689af-2e26-4bd0-be39-b27b223d54e0 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:32:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:32:00 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:32:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7a689af-2e26-4bd0-be39-b27b223d54e0 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:00 devstack sudo[92923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7a689af-2e26-4bd0-be39-b27b223d54e0 1073741824 Jul 08 14:32:00 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:00 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-2c63dcf4-dc46-41bd-b420-34b3327bc3e9 req-c68a66c3-2a78-4abe-a9de-08b86364099b tempest-VolumesSnapshotsTestJSON-1241784614 None] Create snapshot completed successfully Jul 08 14:32:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-3ff677af-9c11-4ed3-9230-015983f1ba17 req-41eb45af-8292-497f-b873-6a549593639a tempest-VolumesSnapshotsTestJSON-1241784614 None] Acquiring lock "cinder-65aae39a-a322-4566-ac15-9eeff6a74047-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-3ff677af-9c11-4ed3-9230-015983f1ba17 req-41eb45af-8292-497f-b873-6a549593639a tempest-VolumesSnapshotsTestJSON-1241784614 None] Lock "cinder-65aae39a-a322-4566-ac15-9eeff6a74047-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-3ff677af-9c11-4ed3-9230-015983f1ba17 req-41eb45af-8292-497f-b873-6a549593639a tempest-VolumesSnapshotsTestJSON-1241784614 None] Acquiring lock "cinder-quobyte-d296caf1-8201-4a0c-90c9-14e0c1d83b6d" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-3ff677af-9c11-4ed3-9230-015983f1ba17 req-41eb45af-8292-497f-b873-6a549593639a tempest-VolumesSnapshotsTestJSON-1241784614 None] Lock "cinder-quobyte-d296caf1-8201-4a0c-90c9-14e0c1d83b6d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-3ff677af-9c11-4ed3-9230-015983f1ba17 req-41eb45af-8292-497f-b873-6a549593639a tempest-VolumesSnapshotsTestJSON-1241784614 None] Acquiring lock "cinder-quobyte-65aae39a-a322-4566-ac15-9eeff6a74047" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-3ff677af-9c11-4ed3-9230-015983f1ba17 req-41eb45af-8292-497f-b873-6a549593639a tempest-VolumesSnapshotsTestJSON-1241784614 None] Lock "cinder-quobyte-65aae39a-a322-4566-ac15-9eeff6a74047" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [req-3ff677af-9c11-4ed3-9230-015983f1ba17 req-41eb45af-8292-497f-b873-6a549593639a tempest-VolumesSnapshotsTestJSON-1241784614 None] Deleting offline snapshot 65aae39a-a322-4566-ac15-9eeff6a74047 of volume d296caf1-8201-4a0c-90c9-14e0c1d83b6d {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:32:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [req-3ff677af-9c11-4ed3-9230-015983f1ba17 req-41eb45af-8292-497f-b873-6a549593639a tempest-VolumesSnapshotsTestJSON-1241784614 None] snapshot_file for this snap is: volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.65aae39a-a322-4566-ac15-9eeff6a74047 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:32:01 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bc8136-9db2-4142-a4dd-368e506378b4]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-3ff677af-9c11-4ed3-9230-015983f1ba17 req-41eb45af-8292-497f-b873-6a549593639a tempest-VolumesSnapshotsTestJSON-1241784614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.65aae39a-a322-4566-ac15-9eeff6a74047 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:01 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.65aae39a-a322-4566-ac15-9eeff6a74047 Jul 08 14:32:01 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:01 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7a689af-2e26-4bd0-be39-b27b223d54e0 1073741824" returned: 0 in 1.081s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7a689af-2e26-4bd0-be39-b27b223d54e0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:01 devstack sudo[92933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7a689af-2e26-4bd0-be39-b27b223d54e0 Jul 08 14:32:01 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:02 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-3ff677af-9c11-4ed3-9230-015983f1ba17 req-41eb45af-8292-497f-b873-6a549593639a tempest-VolumesSnapshotsTestJSON-1241784614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.65aae39a-a322-4566-ac15-9eeff6a74047" returned: 0 in 0.957s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [req-3ff677af-9c11-4ed3-9230-015983f1ba17 req-41eb45af-8292-497f-b873-6a549593639a tempest-VolumesSnapshotsTestJSON-1241784614 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:32:02 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d2ae11-e1d0-4763-b341-cccf3e2d51b1]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-3ff677af-9c11-4ed3-9230-015983f1ba17 req-41eb45af-8292-497f-b873-6a549593639a tempest-VolumesSnapshotsTestJSON-1241784614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:02 devstack sudo[92938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d Jul 08 14:32:02 devstack sudo[92938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:02 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7a689af-2e26-4bd0-be39-b27b223d54e0" returned: 0 in 0.959s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] <== create_volume: return (2098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:32:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.103s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06896110-2d87-4c74-befc-9f26a6fdaab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7a689af-2e26-4bd0-be39-b27b223d54e0', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed56642-e5df-4f2e-ac58-0430f1763c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:02 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Volume volume-c7a689af-2e26-4bd0-be39-b27b223d54e0 (c7a689af-2e26-4bd0-be39-b27b223d54e0): created successfully Jul 08 14:32:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fed56642-e5df-4f2e-ac58-0430f1763c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Flow 'volume_create_manager' (9ad140eb-f422-4ab1-87cd-2b075d9b7a1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:02 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b4a1c06a-de71-4177-9dfc-955f7b48a863 tempest-VolumesListAdminTestJSON-1758118590 None] Created volume successfully. Jul 08 14:32:03 devstack sudo[92938]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-3ff677af-9c11-4ed3-9230-015983f1ba17 req-41eb45af-8292-497f-b873-6a549593639a tempest-VolumesSnapshotsTestJSON-1241784614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d" returned: 0 in 1.235s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-3ff677af-9c11-4ed3-9230-015983f1ba17 req-41eb45af-8292-497f-b873-6a549593639a tempest-VolumesSnapshotsTestJSON-1241784614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.65aae39a-a322-4566-ac15-9eeff6a74047 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:03 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.65aae39a-a322-4566-ac15-9eeff6a74047 Jul 08 14:32:03 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:05 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-3ff677af-9c11-4ed3-9230-015983f1ba17 req-41eb45af-8292-497f-b873-6a549593639a tempest-VolumesSnapshotsTestJSON-1241784614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.65aae39a-a322-4566-ac15-9eeff6a74047" returned: 0 in 1.609s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-3ff677af-9c11-4ed3-9230-015983f1ba17 req-41eb45af-8292-497f-b873-6a549593639a tempest-VolumesSnapshotsTestJSON-1241784614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.65aae39a-a322-4566-ac15-9eeff6a74047 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:05 devstack sudo[92951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.65aae39a-a322-4566-ac15-9eeff6a74047 Jul 08 14:32:05 devstack sudo[92951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Flow 'volume_create_manager' (3bd9fe85-7bc3-4918-a72c-2453d55b8894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0b7554-36f6-49be-8918-21d3ca8d935f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d0b7554-36f6-49be-8918-21d3ca8d935f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61b35574c1643de80f87f943d46b3cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:05Z,use_quota=True,user_id='4783cf15c4fa4f2583840119eb1b22fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (794a95f7-0172-4b6d-9277-9a771dc2a8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (794a95f7-0172-4b6d-9277-9a771dc2a8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb35ca7-c421-41b9-8174-351273e03c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb35ca7-c421-41b9-8174-351273e03c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e', 'volume_name': 'volume-e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9034e97-3309-4cda-a257-36d7d922538a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9034e97-3309-4cda-a257-36d7d922538a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b3b09a-d138-4a6b-84d5-dee40f5764c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:05 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Volume e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e', 'volume_size': 1} Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b61b35574c1643de80f87f943d46b3cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:05Z,use_quota=True,user_id='4783cf15c4fa4f2583840119eb1b22fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Creating volume e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:32:05 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:32:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:05 devstack sudo[92956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e 1073741824 Jul 08 14:32:05 devstack sudo[92956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:06 devstack sudo[92951]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-3ff677af-9c11-4ed3-9230-015983f1ba17 req-41eb45af-8292-497f-b873-6a549593639a tempest-VolumesSnapshotsTestJSON-1241784614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d.65aae39a-a322-4566-ac15-9eeff6a74047" returned: 0 in 1.656s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-3ff677af-9c11-4ed3-9230-015983f1ba17 req-41eb45af-8292-497f-b873-6a549593639a tempest-VolumesSnapshotsTestJSON-1241784614 None] Lock "cinder-quobyte-65aae39a-a322-4566-ac15-9eeff6a74047" released by "_delete_snapshot" :: held 5.633s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-3ff677af-9c11-4ed3-9230-015983f1ba17 req-41eb45af-8292-497f-b873-6a549593639a tempest-VolumesSnapshotsTestJSON-1241784614 None] Lock "cinder-quobyte-d296caf1-8201-4a0c-90c9-14e0c1d83b6d" released by "delete_snapshot" :: held 5.670s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:06 devstack cinder-volume[87240]: WARNING cinder.quota [req-3ff677af-9c11-4ed3-9230-015983f1ba17 req-41eb45af-8292-497f-b873-6a549593639a tempest-VolumesSnapshotsTestJSON-1241784614 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:32:06 devstack cinder-volume[87240]: DEBUG cinder.quota [req-3ff677af-9c11-4ed3-9230-015983f1ba17 req-41eb45af-8292-497f-b873-6a549593639a tempest-VolumesSnapshotsTestJSON-1241784614 None] Created reservations ['5b541a36-c725-4b05-9b68-982f00b11c87', '277b3ca1-02f3-4650-be5a-33830b549c2e', '73e7ac94-7d38-4dd7-835d-ca9160581573', 'c84ac6fa-ef24-459e-ae9d-d28610833449'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:32:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-3ff677af-9c11-4ed3-9230-015983f1ba17 req-41eb45af-8292-497f-b873-6a549593639a tempest-VolumesSnapshotsTestJSON-1241784614 None] Delete snapshot completed successfully. Jul 08 14:32:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-3ff677af-9c11-4ed3-9230-015983f1ba17 req-41eb45af-8292-497f-b873-6a549593639a tempest-VolumesSnapshotsTestJSON-1241784614 None] Lock "cinder-65aae39a-a322-4566-ac15-9eeff6a74047-delete_snapshot" released by "delete_snapshot" :: held 5.981s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:07 devstack sudo[92956]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e 1073741824" returned: 0 in 1.596s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:07 devstack sudo[93002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e Jul 08 14:32:07 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-9cc80e6d-4d3e-4a53-8368-bbedfeb74b3b req-466a6cc5-fa18-45c8-b9dd-f46061855cd4 tempest-VolumesSnapshotsTestJSON-1241784614 None] Acquiring lock "cinder-d296caf1-8201-4a0c-90c9-14e0c1d83b6d-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-9cc80e6d-4d3e-4a53-8368-bbedfeb74b3b req-466a6cc5-fa18-45c8-b9dd-f46061855cd4 tempest-VolumesSnapshotsTestJSON-1241784614 None] Lock "cinder-d296caf1-8201-4a0c-90c9-14e0c1d83b6d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-9cc80e6d-4d3e-4a53-8368-bbedfeb74b3b req-466a6cc5-fa18-45c8-b9dd-f46061855cd4 tempest-VolumesSnapshotsTestJSON-1241784614 None] Acquiring lock "cinder-quobyte-d296caf1-8201-4a0c-90c9-14e0c1d83b6d" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-9cc80e6d-4d3e-4a53-8368-bbedfeb74b3b req-466a6cc5-fa18-45c8-b9dd-f46061855cd4 tempest-VolumesSnapshotsTestJSON-1241784614 None] Lock "cinder-quobyte-d296caf1-8201-4a0c-90c9-14e0c1d83b6d" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:08 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd8e26b-7fd6-4c2f-b71b-da8a584421c4]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-9cc80e6d-4d3e-4a53-8368-bbedfeb74b3b req-466a6cc5-fa18-45c8-b9dd-f46061855cd4 tempest-VolumesSnapshotsTestJSON-1241784614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:08 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e" returned: 0 in 0.756s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] <== create_volume: return (2434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:32:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.438s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7b3b09a-d138-4a6b-84d5-dee40f5764c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab9d022-dba6-495f-9009-feb37063fb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:08 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Volume volume-e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e (e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e): created successfully Jul 08 14:32:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab9d022-dba6-495f-9009-feb37063fb79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Flow 'volume_create_manager' (3bd9fe85-7bc3-4918-a72c-2453d55b8894) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:08 devstack sudo[93005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d Jul 08 14:32:08 devstack sudo[93005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d886fdee-c6ea-41a8-b39d-ee8629d62fa8 tempest-VolumesListAdminTestJSON-1670620541 None] Created volume successfully. Jul 08 14:32:09 devstack sudo[93005]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-9cc80e6d-4d3e-4a53-8368-bbedfeb74b3b req-466a6cc5-fa18-45c8-b9dd-f46061855cd4 tempest-VolumesSnapshotsTestJSON-1241784614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d" returned: 0 in 0.861s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-9cc80e6d-4d3e-4a53-8368-bbedfeb74b3b req-466a6cc5-fa18-45c8-b9dd-f46061855cd4 tempest-VolumesSnapshotsTestJSON-1241784614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:09 devstack sudo[93010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d Jul 08 14:32:09 devstack sudo[93010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-49dd49d0-597d-487e-bb26-2f583f4de099 tempest-VolumesListAdminTestJSON-1670620541 None] Acquiring lock "cinder-e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-49dd49d0-597d-487e-bb26-2f583f4de099 tempest-VolumesListAdminTestJSON-1670620541 None] Lock "cinder-e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-49dd49d0-597d-487e-bb26-2f583f4de099 tempest-VolumesListAdminTestJSON-1670620541 None] Acquiring lock "cinder-quobyte-e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-49dd49d0-597d-487e-bb26-2f583f4de099 tempest-VolumesListAdminTestJSON-1670620541 None] Lock "cinder-quobyte-e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e" acquired by "delete_volume" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:09 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[21218162-d7b9-428b-82bc-152135974db6]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-49dd49d0-597d-487e-bb26-2f583f4de099 tempest-VolumesListAdminTestJSON-1670620541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0d3fe9d5-e5d0-48c9-9e3e-6337d98f171c tempest-VolumesListAdminTestJSON-1758118590 None] Acquiring lock "cinder-c7a689af-2e26-4bd0-be39-b27b223d54e0-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0d3fe9d5-e5d0-48c9-9e3e-6337d98f171c tempest-VolumesListAdminTestJSON-1758118590 None] Lock "cinder-c7a689af-2e26-4bd0-be39-b27b223d54e0-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:09 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e Jul 08 14:32:09 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0d3fe9d5-e5d0-48c9-9e3e-6337d98f171c tempest-VolumesListAdminTestJSON-1758118590 None] Acquiring lock "cinder-quobyte-c7a689af-2e26-4bd0-be39-b27b223d54e0" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0d3fe9d5-e5d0-48c9-9e3e-6337d98f171c tempest-VolumesListAdminTestJSON-1758118590 None] Lock "cinder-quobyte-c7a689af-2e26-4bd0-be39-b27b223d54e0" acquired by "delete_volume" :: waited 0.049s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:09 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba639355-6549-4790-b086-d337d49e9fbd]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0d3fe9d5-e5d0-48c9-9e3e-6337d98f171c tempest-VolumesListAdminTestJSON-1758118590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7a689af-2e26-4bd0-be39-b27b223d54e0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:09 devstack sudo[93014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7a689af-2e26-4bd0-be39-b27b223d54e0 Jul 08 14:32:09 devstack sudo[93014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:09 devstack sudo[93010]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-9cc80e6d-4d3e-4a53-8368-bbedfeb74b3b req-466a6cc5-fa18-45c8-b9dd-f46061855cd4 tempest-VolumesSnapshotsTestJSON-1241784614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d296caf1-8201-4a0c-90c9-14e0c1d83b6d" returned: 0 in 0.860s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-9cc80e6d-4d3e-4a53-8368-bbedfeb74b3b req-466a6cc5-fa18-45c8-b9dd-f46061855cd4 tempest-VolumesSnapshotsTestJSON-1241784614 None] Lock "cinder-quobyte-d296caf1-8201-4a0c-90c9-14e0c1d83b6d" released by "delete_volume" :: held 1.816s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:10 devstack cinder-volume[87240]: DEBUG cinder.quota [req-9cc80e6d-4d3e-4a53-8368-bbedfeb74b3b req-466a6cc5-fa18-45c8-b9dd-f46061855cd4 tempest-VolumesSnapshotsTestJSON-1241784614 None] Created reservations ['19c13733-af35-4098-8210-e0f574aa87f4', 'b9f104a1-9f9a-4d22-9973-d9ef3fb4d2ef', '023fae4f-feb2-4d9c-8102-561de02f0917', '89f13a95-1f0b-4555-b158-38ae4912c4f2'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:32:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-9cc80e6d-4d3e-4a53-8368-bbedfeb74b3b req-466a6cc5-fa18-45c8-b9dd-f46061855cd4 tempest-VolumesSnapshotsTestJSON-1241784614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-9cc80e6d-4d3e-4a53-8368-bbedfeb74b3b req-466a6cc5-fa18-45c8-b9dd-f46061855cd4 tempest-VolumesSnapshotsTestJSON-1241784614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-9cc80e6d-4d3e-4a53-8368-bbedfeb74b3b req-466a6cc5-fa18-45c8-b9dd-f46061855cd4 tempest-VolumesSnapshotsTestJSON-1241784614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-9cc80e6d-4d3e-4a53-8368-bbedfeb74b3b req-466a6cc5-fa18-45c8-b9dd-f46061855cd4 tempest-VolumesSnapshotsTestJSON-1241784614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-9cc80e6d-4d3e-4a53-8368-bbedfeb74b3b req-466a6cc5-fa18-45c8-b9dd-f46061855cd4 tempest-VolumesSnapshotsTestJSON-1241784614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-9cc80e6d-4d3e-4a53-8368-bbedfeb74b3b req-466a6cc5-fa18-45c8-b9dd-f46061855cd4 tempest-VolumesSnapshotsTestJSON-1241784614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:10 devstack sudo[93045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:32:10 devstack sudo[93045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:10 devstack sudo[93014]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0d3fe9d5-e5d0-48c9-9e3e-6337d98f171c tempest-VolumesListAdminTestJSON-1758118590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7a689af-2e26-4bd0-be39-b27b223d54e0" returned: 0 in 1.262s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0d3fe9d5-e5d0-48c9-9e3e-6337d98f171c tempest-VolumesListAdminTestJSON-1758118590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7a689af-2e26-4bd0-be39-b27b223d54e0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:10 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-49dd49d0-597d-487e-bb26-2f583f4de099 tempest-VolumesListAdminTestJSON-1670620541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e" returned: 0 in 1.591s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-49dd49d0-597d-487e-bb26-2f583f4de099 tempest-VolumesListAdminTestJSON-1670620541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:10 devstack sudo[93084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7a689af-2e26-4bd0-be39-b27b223d54e0 Jul 08 14:32:10 devstack sudo[93084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:10 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e Jul 08 14:32:10 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:11 devstack sudo[93045]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-9cc80e6d-4d3e-4a53-8368-bbedfeb74b3b req-466a6cc5-fa18-45c8-b9dd-f46061855cd4 tempest-VolumesSnapshotsTestJSON-1241784614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.264s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:11 devstack cinder-volume[87240]: DEBUG cinder.manager [req-9cc80e6d-4d3e-4a53-8368-bbedfeb74b3b req-466a6cc5-fa18-45c8-b9dd-f46061855cd4 tempest-VolumesSnapshotsTestJSON-1241784614 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:32:11 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-9cc80e6d-4d3e-4a53-8368-bbedfeb74b3b req-466a6cc5-fa18-45c8-b9dd-f46061855cd4 tempest-VolumesSnapshotsTestJSON-1241784614 None] Deleted volume successfully. Jul 08 14:32:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-9cc80e6d-4d3e-4a53-8368-bbedfeb74b3b req-466a6cc5-fa18-45c8-b9dd-f46061855cd4 tempest-VolumesSnapshotsTestJSON-1241784614 None] Lock "cinder-d296caf1-8201-4a0c-90c9-14e0c1d83b6d-delete_volume" released by "delete_volume" :: held 3.507s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:12 devstack sudo[93084]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0d3fe9d5-e5d0-48c9-9e3e-6337d98f171c tempest-VolumesListAdminTestJSON-1758118590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7a689af-2e26-4bd0-be39-b27b223d54e0" returned: 0 in 1.261s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0d3fe9d5-e5d0-48c9-9e3e-6337d98f171c tempest-VolumesListAdminTestJSON-1758118590 None] Lock "cinder-quobyte-c7a689af-2e26-4bd0-be39-b27b223d54e0" released by "delete_volume" :: held 2.590s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:12 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-0d3fe9d5-e5d0-48c9-9e3e-6337d98f171c tempest-VolumesListAdminTestJSON-1758118590 None] Created reservations ['0f5ba67d-86aa-4c38-9cc9-852c3df27047', 'e6d9f587-9ea7-45b8-80a6-049e3df195bc', 'e1893ff0-4392-41de-a702-2282f8326632', '45a685f4-824c-435b-9623-fdfa83e5cd81'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:32:12 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-49dd49d0-597d-487e-bb26-2f583f4de099 tempest-VolumesListAdminTestJSON-1670620541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e" returned: 0 in 1.416s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-49dd49d0-597d-487e-bb26-2f583f4de099 tempest-VolumesListAdminTestJSON-1670620541 None] Lock "cinder-quobyte-e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e" released by "delete_volume" :: held 3.074s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0d3fe9d5-e5d0-48c9-9e3e-6337d98f171c tempest-VolumesListAdminTestJSON-1758118590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0d3fe9d5-e5d0-48c9-9e3e-6337d98f171c tempest-VolumesListAdminTestJSON-1758118590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0d3fe9d5-e5d0-48c9-9e3e-6337d98f171c tempest-VolumesListAdminTestJSON-1758118590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0d3fe9d5-e5d0-48c9-9e3e-6337d98f171c tempest-VolumesListAdminTestJSON-1758118590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0d3fe9d5-e5d0-48c9-9e3e-6337d98f171c tempest-VolumesListAdminTestJSON-1758118590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0d3fe9d5-e5d0-48c9-9e3e-6337d98f171c tempest-VolumesListAdminTestJSON-1758118590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:12 devstack sudo[93128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:32:12 devstack sudo[93128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:12 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-49dd49d0-597d-487e-bb26-2f583f4de099 tempest-VolumesListAdminTestJSON-1670620541 None] Created reservations ['6a78cbdc-3822-4ef2-8ad7-d4ef341001d5', 'ef196da7-c0c0-478a-92b1-2f51c9d4c883', 'e3758180-cffe-4ae5-8753-7474c41161e6', '8fb10b7f-08cc-4230-8ce6-183d06121733'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:32:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-49dd49d0-597d-487e-bb26-2f583f4de099 tempest-VolumesListAdminTestJSON-1670620541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-49dd49d0-597d-487e-bb26-2f583f4de099 tempest-VolumesListAdminTestJSON-1670620541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-49dd49d0-597d-487e-bb26-2f583f4de099 tempest-VolumesListAdminTestJSON-1670620541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-49dd49d0-597d-487e-bb26-2f583f4de099 tempest-VolumesListAdminTestJSON-1670620541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-49dd49d0-597d-487e-bb26-2f583f4de099 tempest-VolumesListAdminTestJSON-1670620541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-49dd49d0-597d-487e-bb26-2f583f4de099 tempest-VolumesListAdminTestJSON-1670620541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:12 devstack sudo[93130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:32:12 devstack sudo[93130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a6d0e989-e3e2-468d-90b6-7b43622ff3a4 tempest-VolumesListAdminTestJSON-1758118590 None] Acquiring lock "cinder-2d2423b0-300a-40e2-abbd-42c240da3a27-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a6d0e989-e3e2-468d-90b6-7b43622ff3a4 tempest-VolumesListAdminTestJSON-1758118590 None] Lock "cinder-2d2423b0-300a-40e2-abbd-42c240da3a27-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a6d0e989-e3e2-468d-90b6-7b43622ff3a4 tempest-VolumesListAdminTestJSON-1758118590 None] Acquiring lock "cinder-quobyte-2d2423b0-300a-40e2-abbd-42c240da3a27" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a6d0e989-e3e2-468d-90b6-7b43622ff3a4 tempest-VolumesListAdminTestJSON-1758118590 None] Lock "cinder-quobyte-2d2423b0-300a-40e2-abbd-42c240da3a27" acquired by "delete_volume" :: waited 0.047s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:13 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30ad816-f1a5-4b8c-b760-09b7760c297c]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6d0e989-e3e2-468d-90b6-7b43622ff3a4 tempest-VolumesListAdminTestJSON-1758118590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2d2423b0-300a-40e2-abbd-42c240da3a27 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:13 devstack sudo[93132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2d2423b0-300a-40e2-abbd-42c240da3a27 Jul 08 14:32:13 devstack sudo[93132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:13 devstack sudo[93128]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0d3fe9d5-e5d0-48c9-9e3e-6337d98f171c tempest-VolumesListAdminTestJSON-1758118590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.353s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:13 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-0d3fe9d5-e5d0-48c9-9e3e-6337d98f171c tempest-VolumesListAdminTestJSON-1758118590 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:32:13 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0d3fe9d5-e5d0-48c9-9e3e-6337d98f171c tempest-VolumesListAdminTestJSON-1758118590 None] Deleted volume successfully. Jul 08 14:32:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0d3fe9d5-e5d0-48c9-9e3e-6337d98f171c tempest-VolumesListAdminTestJSON-1758118590 None] Lock "cinder-c7a689af-2e26-4bd0-be39-b27b223d54e0-delete_volume" released by "delete_volume" :: held 4.348s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:13 devstack sudo[93130]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-49dd49d0-597d-487e-bb26-2f583f4de099 tempest-VolumesListAdminTestJSON-1670620541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.452s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:13 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-49dd49d0-597d-487e-bb26-2f583f4de099 tempest-VolumesListAdminTestJSON-1670620541 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:32:14 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-49dd49d0-597d-487e-bb26-2f583f4de099 tempest-VolumesListAdminTestJSON-1670620541 None] Deleted volume successfully. Jul 08 14:32:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-49dd49d0-597d-487e-bb26-2f583f4de099 tempest-VolumesListAdminTestJSON-1670620541 None] Lock "cinder-e1dd9ca2-9cdf-41a9-8127-ac6e4efd3f6e-delete_volume" released by "delete_volume" :: held 4.920s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:14 devstack sudo[93132]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6d0e989-e3e2-468d-90b6-7b43622ff3a4 tempest-VolumesListAdminTestJSON-1758118590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2d2423b0-300a-40e2-abbd-42c240da3a27" returned: 0 in 1.348s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6d0e989-e3e2-468d-90b6-7b43622ff3a4 tempest-VolumesListAdminTestJSON-1758118590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2d2423b0-300a-40e2-abbd-42c240da3a27 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:14 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2d2423b0-300a-40e2-abbd-42c240da3a27 Jul 08 14:32:14 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:15 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6d0e989-e3e2-468d-90b6-7b43622ff3a4 tempest-VolumesListAdminTestJSON-1758118590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2d2423b0-300a-40e2-abbd-42c240da3a27" returned: 0 in 0.987s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a6d0e989-e3e2-468d-90b6-7b43622ff3a4 tempest-VolumesListAdminTestJSON-1758118590 None] Lock "cinder-quobyte-2d2423b0-300a-40e2-abbd-42c240da3a27" released by "delete_volume" :: held 2.430s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:15 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=62,cinder:SELECT=66,cinder:INSERT=15,cinder:DELETE=5 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:32:15 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-a6d0e989-e3e2-468d-90b6-7b43622ff3a4 tempest-VolumesListAdminTestJSON-1758118590 None] Created reservations ['6adcb457-70f3-4b05-82e0-70956a3e3e49', '67c4d52a-f606-46e9-8912-5195aac4cfc1', 'f8447eef-9bb4-4ecb-81f6-371958b79f5a', '792cca6d-aeb5-4461-b126-83d408672fb6'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:32:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a6d0e989-e3e2-468d-90b6-7b43622ff3a4 tempest-VolumesListAdminTestJSON-1758118590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a6d0e989-e3e2-468d-90b6-7b43622ff3a4 tempest-VolumesListAdminTestJSON-1758118590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a6d0e989-e3e2-468d-90b6-7b43622ff3a4 tempest-VolumesListAdminTestJSON-1758118590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a6d0e989-e3e2-468d-90b6-7b43622ff3a4 tempest-VolumesListAdminTestJSON-1758118590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a6d0e989-e3e2-468d-90b6-7b43622ff3a4 tempest-VolumesListAdminTestJSON-1758118590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6d0e989-e3e2-468d-90b6-7b43622ff3a4 tempest-VolumesListAdminTestJSON-1758118590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:16 devstack sudo[93145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:32:16 devstack sudo[93145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-68f3220d-e4a6-4fed-be76-9dc825a7c31d tempest-VolumesListAdminTestJSON-1758118590 None] Acquiring lock "cinder-8269ae88-0fe1-4d68-8dda-f4eac1bfd91e-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-68f3220d-e4a6-4fed-be76-9dc825a7c31d tempest-VolumesListAdminTestJSON-1758118590 None] Lock "cinder-8269ae88-0fe1-4d68-8dda-f4eac1bfd91e-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-68f3220d-e4a6-4fed-be76-9dc825a7c31d tempest-VolumesListAdminTestJSON-1758118590 None] Acquiring lock "cinder-quobyte-8269ae88-0fe1-4d68-8dda-f4eac1bfd91e" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-68f3220d-e4a6-4fed-be76-9dc825a7c31d tempest-VolumesListAdminTestJSON-1758118590 None] Lock "cinder-quobyte-8269ae88-0fe1-4d68-8dda-f4eac1bfd91e" acquired by "delete_volume" :: waited 0.034s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:17 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[470b7e47-29ba-46e5-be22-29c2b2f15d97]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68f3220d-e4a6-4fed-be76-9dc825a7c31d tempest-VolumesListAdminTestJSON-1758118590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8269ae88-0fe1-4d68-8dda-f4eac1bfd91e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:17 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8269ae88-0fe1-4d68-8dda-f4eac1bfd91e Jul 08 14:32:17 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:17 devstack sudo[93145]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6d0e989-e3e2-468d-90b6-7b43622ff3a4 tempest-VolumesListAdminTestJSON-1758118590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.502s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:17 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-a6d0e989-e3e2-468d-90b6-7b43622ff3a4 tempest-VolumesListAdminTestJSON-1758118590 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:32:17 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a6d0e989-e3e2-468d-90b6-7b43622ff3a4 tempest-VolumesListAdminTestJSON-1758118590 None] Deleted volume successfully. Jul 08 14:32:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a6d0e989-e3e2-468d-90b6-7b43622ff3a4 tempest-VolumesListAdminTestJSON-1758118590 None] Lock "cinder-2d2423b0-300a-40e2-abbd-42c240da3a27-delete_volume" released by "delete_volume" :: held 4.533s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:18 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68f3220d-e4a6-4fed-be76-9dc825a7c31d tempest-VolumesListAdminTestJSON-1758118590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8269ae88-0fe1-4d68-8dda-f4eac1bfd91e" returned: 0 in 1.951s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68f3220d-e4a6-4fed-be76-9dc825a7c31d tempest-VolumesListAdminTestJSON-1758118590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8269ae88-0fe1-4d68-8dda-f4eac1bfd91e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:19 devstack sudo[93154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8269ae88-0fe1-4d68-8dda-f4eac1bfd91e Jul 08 14:32:19 devstack sudo[93154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:20 devstack sudo[93154]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68f3220d-e4a6-4fed-be76-9dc825a7c31d tempest-VolumesListAdminTestJSON-1758118590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8269ae88-0fe1-4d68-8dda-f4eac1bfd91e" returned: 0 in 1.538s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-68f3220d-e4a6-4fed-be76-9dc825a7c31d tempest-VolumesListAdminTestJSON-1758118590 None] Lock "cinder-quobyte-8269ae88-0fe1-4d68-8dda-f4eac1bfd91e" released by "delete_volume" :: held 3.580s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:20 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=63,cinder:UPDATE=83,cinder:INSERT=20,cinder:DELETE=7 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:32:20 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-68f3220d-e4a6-4fed-be76-9dc825a7c31d tempest-VolumesListAdminTestJSON-1758118590 None] Created reservations ['f466b1e5-42a9-4360-a11b-b696e038238d', '5a4872be-94d8-4ab1-9333-9b634ca10fbc', '3e1b8527-3a00-424b-9b51-cc7970bcc4ba', '9ec2adb2-19b5-44be-b61b-55b8973226d3'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:32:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-68f3220d-e4a6-4fed-be76-9dc825a7c31d tempest-VolumesListAdminTestJSON-1758118590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-68f3220d-e4a6-4fed-be76-9dc825a7c31d tempest-VolumesListAdminTestJSON-1758118590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-68f3220d-e4a6-4fed-be76-9dc825a7c31d tempest-VolumesListAdminTestJSON-1758118590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-68f3220d-e4a6-4fed-be76-9dc825a7c31d tempest-VolumesListAdminTestJSON-1758118590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-68f3220d-e4a6-4fed-be76-9dc825a7c31d tempest-VolumesListAdminTestJSON-1758118590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68f3220d-e4a6-4fed-be76-9dc825a7c31d tempest-VolumesListAdminTestJSON-1758118590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:21 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:32:21 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:22 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-68f3220d-e4a6-4fed-be76-9dc825a7c31d tempest-VolumesListAdminTestJSON-1758118590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.113s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:22 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-68f3220d-e4a6-4fed-be76-9dc825a7c31d tempest-VolumesListAdminTestJSON-1758118590 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:32:22 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-68f3220d-e4a6-4fed-be76-9dc825a7c31d tempest-VolumesListAdminTestJSON-1758118590 None] Deleted volume successfully. Jul 08 14:32:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-68f3220d-e4a6-4fed-be76-9dc825a7c31d tempest-VolumesListAdminTestJSON-1758118590 None] Lock "cinder-8269ae88-0fe1-4d68-8dda-f4eac1bfd91e-delete_volume" released by "delete_volume" :: held 5.322s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:22 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-dfedec55-cf57-4b17-8d2b-91f6619e8686 req-0c3729a3-ad3c-40ba-a4c8-56816d6a7965 tempest-ServerActionsTestOtherA-1815051181 None] Terminate volume connection completed successfully. Jul 08 14:32:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-dfedec55-cf57-4b17-8d2b-91f6619e8686 req-0c3729a3-ad3c-40ba-a4c8-56816d6a7965 tempest-ServerActionsTestOtherA-1815051181 None] Deleting attachment 2596cb19-d205-4f0a-981e-e38d3f1dc995. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:32:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e94c5090-1705-441d-94e6-6823ec020aca tempest-GroupsV320Test-1724389473 None] Group tempest-GroupsV320Test-Group-536453852: creating Jul 08 14:32:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e94c5090-1705-441d-94e6-6823ec020aca tempest-GroupsV320Test-1724389473 None] Group tempest-GroupsV320Test-Group-536453852: created successfully Jul 08 14:32:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e94c5090-1705-441d-94e6-6823ec020aca tempest-GroupsV320Test-1724389473 None] Create group completed successfully. Jul 08 14:32:28 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-31856757-9c57-40bb-ad6a-47b2ac1baedf tempest-GroupsV320Test-1724389473 None] Created reservations ['b12ec21e-0c56-4ce0-84eb-f79409303eae'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:32:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-31856757-9c57-40bb-ad6a-47b2ac1baedf tempest-GroupsV320Test-1724389473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-31856757-9c57-40bb-ad6a-47b2ac1baedf tempest-GroupsV320Test-1724389473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-31856757-9c57-40bb-ad6a-47b2ac1baedf tempest-GroupsV320Test-1724389473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-31856757-9c57-40bb-ad6a-47b2ac1baedf tempest-GroupsV320Test-1724389473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-31856757-9c57-40bb-ad6a-47b2ac1baedf tempest-GroupsV320Test-1724389473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-31856757-9c57-40bb-ad6a-47b2ac1baedf tempest-GroupsV320Test-1724389473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:28 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:32:28 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:29 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-31856757-9c57-40bb-ad6a-47b2ac1baedf tempest-GroupsV320Test-1724389473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.790s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:29 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-31856757-9c57-40bb-ad6a-47b2ac1baedf tempest-GroupsV320Test-1724389473 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:32:29 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-31856757-9c57-40bb-ad6a-47b2ac1baedf tempest-GroupsV320Test-1724389473 None] Delete group completed successfully. Jul 08 14:32:33 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:32:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Flow 'volume_create_manager' (045b46fd-4720-4931-acb0-a01a0e7a91d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a47716-1d13-412c-8be1-0a9797d653fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89a47716-1d13-412c-8be1-0a9797d653fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1366570115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad93dbca-ba54-4429-b8f6-215ad1484683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77a3740701a14a648396c476a93311a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:34Z,use_quota=True,user_id='2a6bcb5b593e4f91a927fc8ccdcd2934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a58308c-d039-45e6-8d24-4391045230d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a58308c-d039-45e6-8d24-4391045230d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbba6ef-db84-43e1-b62f-044ed0c39009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbba6ef-db84-43e1-b62f-044ed0c39009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad93dbca-ba54-4429-b8f6-215ad1484683', 'volume_name': 'volume-ad93dbca-ba54-4429-b8f6-215ad1484683', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe26f531-0ba0-459f-bba4-dcaa781c1edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe26f531-0ba0-459f-bba4-dcaa781c1edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (babc7420-e9aa-4e95-b6db-171460552f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:33 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Volume ad93dbca-ba54-4429-b8f6-215ad1484683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad93dbca-ba54-4429-b8f6-215ad1484683', 'volume_size': 1} Jul 08 14:32:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1366570115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad93dbca-ba54-4429-b8f6-215ad1484683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77a3740701a14a648396c476a93311a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:34Z,use_quota=True,user_id='2a6bcb5b593e4f91a927fc8ccdcd2934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:32:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Creating volume ad93dbca-ba54-4429-b8f6-215ad1484683 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:32:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:32:33 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:32:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ad93dbca-ba54-4429-b8f6-215ad1484683 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:33 devstack sudo[93225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ad93dbca-ba54-4429-b8f6-215ad1484683 1073741824 Jul 08 14:32:33 devstack sudo[93225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a904c3e9-e5a9-4d3c-8730-7b84e84b603b tempest-ServerActionsTestOtherA-1815051181 None] Acquiring lock "cinder-bb585dc1-2d21-4692-bef0-4167c6b1765b-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a904c3e9-e5a9-4d3c-8730-7b84e84b603b tempest-ServerActionsTestOtherA-1815051181 None] Lock "cinder-bb585dc1-2d21-4692-bef0-4167c6b1765b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a904c3e9-e5a9-4d3c-8730-7b84e84b603b tempest-ServerActionsTestOtherA-1815051181 None] Acquiring lock "cinder-quobyte-bb585dc1-2d21-4692-bef0-4167c6b1765b" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a904c3e9-e5a9-4d3c-8730-7b84e84b603b tempest-ServerActionsTestOtherA-1815051181 None] Lock "cinder-quobyte-bb585dc1-2d21-4692-bef0-4167c6b1765b" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:34 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[3291cace-5158-49f7-ab2c-7a2afe0bbe34]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a904c3e9-e5a9-4d3c-8730-7b84e84b603b tempest-ServerActionsTestOtherA-1815051181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bb585dc1-2d21-4692-bef0-4167c6b1765b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:34 devstack sudo[93227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bb585dc1-2d21-4692-bef0-4167c6b1765b Jul 08 14:32:34 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:35 devstack sudo[93225]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ad93dbca-ba54-4429-b8f6-215ad1484683 1073741824" returned: 0 in 1.289s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ad93dbca-ba54-4429-b8f6-215ad1484683 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:35 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ad93dbca-ba54-4429-b8f6-215ad1484683 Jul 08 14:32:35 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:35 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a904c3e9-e5a9-4d3c-8730-7b84e84b603b tempest-ServerActionsTestOtherA-1815051181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bb585dc1-2d21-4692-bef0-4167c6b1765b" returned: 0 in 1.077s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a904c3e9-e5a9-4d3c-8730-7b84e84b603b tempest-ServerActionsTestOtherA-1815051181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bb585dc1-2d21-4692-bef0-4167c6b1765b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:35 devstack sudo[93239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bb585dc1-2d21-4692-bef0-4167c6b1765b Jul 08 14:32:35 devstack sudo[93239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:36 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ad93dbca-ba54-4429-b8f6-215ad1484683" returned: 0 in 0.862s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] <== create_volume: return (2227ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:32:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.232s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (babc7420-e9aa-4e95-b6db-171460552f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad93dbca-ba54-4429-b8f6-215ad1484683', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11018ad3-e332-4d5d-840d-6e20d849bfcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:36 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Volume volume-ad93dbca-ba54-4429-b8f6-215ad1484683 (ad93dbca-ba54-4429-b8f6-215ad1484683): created successfully Jul 08 14:32:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11018ad3-e332-4d5d-840d-6e20d849bfcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Flow 'volume_create_manager' (045b46fd-4720-4931-acb0-a01a0e7a91d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:36 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-464812db-487a-48eb-8d86-ebf79a16d56f tempest-VolumesTransfersTest-1376365729 None] Created volume successfully. Jul 08 14:32:36 devstack sudo[93239]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a904c3e9-e5a9-4d3c-8730-7b84e84b603b tempest-ServerActionsTestOtherA-1815051181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bb585dc1-2d21-4692-bef0-4167c6b1765b" returned: 0 in 0.884s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a904c3e9-e5a9-4d3c-8730-7b84e84b603b tempest-ServerActionsTestOtherA-1815051181 None] Lock "cinder-quobyte-bb585dc1-2d21-4692-bef0-4167c6b1765b" released by "delete_volume" :: held 2.035s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:36 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-a904c3e9-e5a9-4d3c-8730-7b84e84b603b tempest-ServerActionsTestOtherA-1815051181 None] Created reservations ['08f5bdc3-b5ea-45ee-829f-d6095ddee24a', 'e4a8cf00-b27f-4199-8746-ea153bad0640', '74ff99a6-8a18-49ac-9e30-e7ab0f90101b', '036b1742-f7cb-4f37-bf5f-071404e7a3b2'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:32:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a904c3e9-e5a9-4d3c-8730-7b84e84b603b tempest-ServerActionsTestOtherA-1815051181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a904c3e9-e5a9-4d3c-8730-7b84e84b603b tempest-ServerActionsTestOtherA-1815051181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a904c3e9-e5a9-4d3c-8730-7b84e84b603b tempest-ServerActionsTestOtherA-1815051181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a904c3e9-e5a9-4d3c-8730-7b84e84b603b tempest-ServerActionsTestOtherA-1815051181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a904c3e9-e5a9-4d3c-8730-7b84e84b603b tempest-ServerActionsTestOtherA-1815051181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a904c3e9-e5a9-4d3c-8730-7b84e84b603b tempest-ServerActionsTestOtherA-1815051181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:36 devstack sudo[93243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:32:36 devstack sudo[93243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:37 devstack sudo[93243]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a904c3e9-e5a9-4d3c-8730-7b84e84b603b tempest-ServerActionsTestOtherA-1815051181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.897s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:37 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-a904c3e9-e5a9-4d3c-8730-7b84e84b603b tempest-ServerActionsTestOtherA-1815051181 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:32:37 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a904c3e9-e5a9-4d3c-8730-7b84e84b603b tempest-ServerActionsTestOtherA-1815051181 None] Deleted volume successfully. Jul 08 14:32:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a904c3e9-e5a9-4d3c-8730-7b84e84b603b tempest-ServerActionsTestOtherA-1815051181 None] Lock "cinder-bb585dc1-2d21-4692-bef0-4167c6b1765b-delete_volume" released by "delete_volume" :: held 3.217s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:37 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d7a52ae7-b9e7-45c7-8f48-40d07040d338 tempest-VolumesTransfersTest-1775642127 None] Transfer volume completed successfully. Jul 08 14:32:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5eabbd85-7bae-4109-a1fd-344b6a96cae4 tempest-VolumesTransfersTest-605374722 None] Acquiring lock "cinder-ad93dbca-ba54-4429-b8f6-215ad1484683-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5eabbd85-7bae-4109-a1fd-344b6a96cae4 tempest-VolumesTransfersTest-605374722 None] Lock "cinder-ad93dbca-ba54-4429-b8f6-215ad1484683-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5eabbd85-7bae-4109-a1fd-344b6a96cae4 tempest-VolumesTransfersTest-605374722 None] Acquiring lock "cinder-quobyte-ad93dbca-ba54-4429-b8f6-215ad1484683" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5eabbd85-7bae-4109-a1fd-344b6a96cae4 tempest-VolumesTransfersTest-605374722 None] Lock "cinder-quobyte-ad93dbca-ba54-4429-b8f6-215ad1484683" acquired by "delete_volume" :: waited 0.052s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:39 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ff893a-276e-490b-8c0d-f1bc402f2d5f]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5eabbd85-7bae-4109-a1fd-344b6a96cae4 tempest-VolumesTransfersTest-605374722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ad93dbca-ba54-4429-b8f6-215ad1484683 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:39 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:32:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Flow 'volume_create_manager' (5df57d10-ad26-454c-af0c-0fc5ebdfdf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e97d9e3-c062-46ac-bc57-ccb84dfa4011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:40 devstack sudo[93308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ad93dbca-ba54-4429-b8f6-215ad1484683 Jul 08 14:32:40 devstack sudo[93308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e97d9e3-c062-46ac-bc57-ccb84dfa4011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2134989841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba27d933-1789-4be5-8ad0-30b7fbbf420c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48483ad562f441158d14a2eee3013bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:40Z,use_quota=True,user_id='f706d1c701ea4e67a1a6571345e20a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f1e6a1-8e2b-4095-96ce-b52bfd7c6292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27f1e6a1-8e2b-4095-96ce-b52bfd7c6292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1205f0fa-897f-4865-834a-0485c2d8e1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1205f0fa-897f-4865-834a-0485c2d8e1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba27d933-1789-4be5-8ad0-30b7fbbf420c', 'volume_name': 'volume-ba27d933-1789-4be5-8ad0-30b7fbbf420c', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767bc6b3-c53a-4190-b778-afcf8724dfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767bc6b3-c53a-4190-b778-afcf8724dfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258e9f9f-2a8c-44ff-bcbc-d32cbcfa24b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:40 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Volume ba27d933-1789-4be5-8ad0-30b7fbbf420c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba27d933-1789-4be5-8ad0-30b7fbbf420c', 'volume_size': 1} Jul 08 14:32:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2134989841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba27d933-1789-4be5-8ad0-30b7fbbf420c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48483ad562f441158d14a2eee3013bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:40Z,use_quota=True,user_id='f706d1c701ea4e67a1a6571345e20a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:32:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Creating volume ba27d933-1789-4be5-8ad0-30b7fbbf420c {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:32:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:32:40 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:32:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ba27d933-1789-4be5-8ad0-30b7fbbf420c 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:40 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ba27d933-1789-4be5-8ad0-30b7fbbf420c 1073741824 Jul 08 14:32:40 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:41 devstack sudo[93308]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5eabbd85-7bae-4109-a1fd-344b6a96cae4 tempest-VolumesTransfersTest-605374722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ad93dbca-ba54-4429-b8f6-215ad1484683" returned: 0 in 1.249s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5eabbd85-7bae-4109-a1fd-344b6a96cae4 tempest-VolumesTransfersTest-605374722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ad93dbca-ba54-4429-b8f6-215ad1484683 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:41 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ad93dbca-ba54-4429-b8f6-215ad1484683 Jul 08 14:32:41 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:41 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ba27d933-1789-4be5-8ad0-30b7fbbf420c 1073741824" returned: 0 in 1.284s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ba27d933-1789-4be5-8ad0-30b7fbbf420c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:41 devstack sudo[93324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ba27d933-1789-4be5-8ad0-30b7fbbf420c Jul 08 14:32:41 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:41 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5eabbd85-7bae-4109-a1fd-344b6a96cae4 tempest-VolumesTransfersTest-605374722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ad93dbca-ba54-4429-b8f6-215ad1484683" returned: 0 in 0.881s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5eabbd85-7bae-4109-a1fd-344b6a96cae4 tempest-VolumesTransfersTest-605374722 None] Lock "cinder-quobyte-ad93dbca-ba54-4429-b8f6-215ad1484683" released by "delete_volume" :: held 2.242s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:42 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-5eabbd85-7bae-4109-a1fd-344b6a96cae4 tempest-VolumesTransfersTest-605374722 None] Created reservations ['b4c7c48a-c457-4677-bfe7-dfebac74b5a4', 'a79cf545-2498-4dc1-8ab8-895dc9bcf554', 'c25ef600-c058-4847-b6cd-28dd6a9c6ab6', '123c78c8-d5b5-49a2-8624-7cb45cc971c9'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:32:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5eabbd85-7bae-4109-a1fd-344b6a96cae4 tempest-VolumesTransfersTest-605374722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5eabbd85-7bae-4109-a1fd-344b6a96cae4 tempest-VolumesTransfersTest-605374722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5eabbd85-7bae-4109-a1fd-344b6a96cae4 tempest-VolumesTransfersTest-605374722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5eabbd85-7bae-4109-a1fd-344b6a96cae4 tempest-VolumesTransfersTest-605374722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5eabbd85-7bae-4109-a1fd-344b6a96cae4 tempest-VolumesTransfersTest-605374722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5eabbd85-7bae-4109-a1fd-344b6a96cae4 tempest-VolumesTransfersTest-605374722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:42 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:32:42 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:42 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ba27d933-1789-4be5-8ad0-30b7fbbf420c" returned: 0 in 0.968s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] <== create_volume: return (2317ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:32:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.321s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (258e9f9f-2a8c-44ff-bcbc-d32cbcfa24b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba27d933-1789-4be5-8ad0-30b7fbbf420c', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62cf493-311a-45f3-9f7f-4ecc05c56d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:42 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Volume volume-ba27d933-1789-4be5-8ad0-30b7fbbf420c (ba27d933-1789-4be5-8ad0-30b7fbbf420c): created successfully Jul 08 14:32:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f62cf493-311a-45f3-9f7f-4ecc05c56d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Flow 'volume_create_manager' (5df57d10-ad26-454c-af0c-0fc5ebdfdf87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a957bdcb-b155-4bae-9778-0cd3785f1e79 tempest-AttachVolumeTestJSON-723745895 None] Created volume successfully. Jul 08 14:32:42 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5eabbd85-7bae-4109-a1fd-344b6a96cae4 tempest-VolumesTransfersTest-605374722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.773s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:42 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-5eabbd85-7bae-4109-a1fd-344b6a96cae4 tempest-VolumesTransfersTest-605374722 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:32:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5eabbd85-7bae-4109-a1fd-344b6a96cae4 tempest-VolumesTransfersTest-605374722 None] Deleted volume successfully. Jul 08 14:32:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5eabbd85-7bae-4109-a1fd-344b6a96cae4 tempest-VolumesTransfersTest-605374722 None] Lock "cinder-ad93dbca-ba54-4429-b8f6-215ad1484683-delete_volume" released by "delete_volume" :: held 3.401s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:43 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:32:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Flow 'volume_create_manager' (e02b3316-5cfb-4e6a-b7e6-b8d58031aadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e2c7fb2-8478-4df1-b492-213cbe278eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e2c7fb2-8478-4df1-b492-213cbe278eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1271138434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354ee997-27cc-48f8-92c8-d104f8a9160c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77a3740701a14a648396c476a93311a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:44Z,use_quota=True,user_id='2a6bcb5b593e4f91a927fc8ccdcd2934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b197c42c-2d23-4f8f-b23c-4160e0871442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b197c42c-2d23-4f8f-b23c-4160e0871442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2b7962-c086-4ca5-9344-00ed69c70821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea2b7962-c086-4ca5-9344-00ed69c70821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '354ee997-27cc-48f8-92c8-d104f8a9160c', 'volume_name': 'volume-354ee997-27cc-48f8-92c8-d104f8a9160c', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c77b7dc-9cde-4d9c-be10-2faeca6598fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c77b7dc-9cde-4d9c-be10-2faeca6598fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a050a915-901a-454a-bbc8-74e8a34a730b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:43 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Volume 354ee997-27cc-48f8-92c8-d104f8a9160c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-354ee997-27cc-48f8-92c8-d104f8a9160c', 'volume_size': 1} Jul 08 14:32:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1271138434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354ee997-27cc-48f8-92c8-d104f8a9160c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77a3740701a14a648396c476a93311a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:44Z,use_quota=True,user_id='2a6bcb5b593e4f91a927fc8ccdcd2934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:32:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Creating volume 354ee997-27cc-48f8-92c8-d104f8a9160c {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:32:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:32:43 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:32:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-354ee997-27cc-48f8-92c8-d104f8a9160c 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:43 devstack sudo[93335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-354ee997-27cc-48f8-92c8-d104f8a9160c 1073741824 Jul 08 14:32:43 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:45 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-354ee997-27cc-48f8-92c8-d104f8a9160c 1073741824" returned: 0 in 1.214s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-354ee997-27cc-48f8-92c8-d104f8a9160c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:45 devstack sudo[93341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-354ee997-27cc-48f8-92c8-d104f8a9160c Jul 08 14:32:45 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:45 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-354ee997-27cc-48f8-92c8-d104f8a9160c" returned: 0 in 0.850s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] <== create_volume: return (2113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:32:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.119s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a050a915-901a-454a-bbc8-74e8a34a730b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-354ee997-27cc-48f8-92c8-d104f8a9160c', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5adde6e5-7100-47df-ac82-778848f35156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:46 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Volume volume-354ee997-27cc-48f8-92c8-d104f8a9160c (354ee997-27cc-48f8-92c8-d104f8a9160c): created successfully Jul 08 14:32:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5adde6e5-7100-47df-ac82-778848f35156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Flow 'volume_create_manager' (e02b3316-5cfb-4e6a-b7e6-b8d58031aadc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-75d5d4ff-643b-46f5-a44f-1d7dc341c337 tempest-VolumesTransfersTest-1376365729 None] Created volume successfully. Jul 08 14:32:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-d3e17849-369b-4b61-8a8a-6f54f05a3cc9 req-8977d7b4-d36a-47f4-ad4f-3cf64e183c0d tempest-AttachVolumeTestJSON-723745895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-d3e17849-369b-4b61-8a8a-6f54f05a3cc9 req-8977d7b4-d36a-47f4-ad4f-3cf64e183c0d tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:46 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3331910-01d8-4d16-8279-6d5b309cb82e]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-d3e17849-369b-4b61-8a8a-6f54f05a3cc9 req-8977d7b4-d36a-47f4-ad4f-3cf64e183c0d tempest-AttachVolumeTestJSON-723745895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ba27d933-1789-4be5-8ad0-30b7fbbf420c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:46 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ba27d933-1789-4be5-8ad0-30b7fbbf420c Jul 08 14:32:46 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-94b05901-e121-4ed0-820e-c2ec3fbd0196 tempest-VolumesTransfersTest-605374722 None] Acquiring lock "cinder-354ee997-27cc-48f8-92c8-d104f8a9160c-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-94b05901-e121-4ed0-820e-c2ec3fbd0196 tempest-VolumesTransfersTest-605374722 None] Lock "cinder-354ee997-27cc-48f8-92c8-d104f8a9160c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:47 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-d3e17849-369b-4b61-8a8a-6f54f05a3cc9 req-8977d7b4-d36a-47f4-ad4f-3cf64e183c0d tempest-AttachVolumeTestJSON-723745895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ba27d933-1789-4be5-8ad0-30b7fbbf420c" returned: 0 in 1.257s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-d3e17849-369b-4b61-8a8a-6f54f05a3cc9 req-8977d7b4-d36a-47f4-ad4f-3cf64e183c0d tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.285s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-94b05901-e121-4ed0-820e-c2ec3fbd0196 tempest-VolumesTransfersTest-605374722 None] Acquiring lock "cinder-quobyte-354ee997-27cc-48f8-92c8-d104f8a9160c" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:32:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-94b05901-e121-4ed0-820e-c2ec3fbd0196 tempest-VolumesTransfersTest-605374722 None] Lock "cinder-quobyte-354ee997-27cc-48f8-92c8-d104f8a9160c" acquired by "delete_volume" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:32:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-d3e17849-369b-4b61-8a8a-6f54f05a3cc9 req-8977d7b4-d36a-47f4-ad4f-3cf64e183c0d tempest-AttachVolumeTestJSON-723745895 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad', 'name': 'volume-ba27d933-1789-4be5-8ad0-30b7fbbf420c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f751ab0a-d6d8-4e25-8b98-9715b71a82ee', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:32:47 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6220c7c7-2c84-40dd-bdba-caf7ff43146a]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-94b05901-e121-4ed0-820e-c2ec3fbd0196 tempest-VolumesTransfersTest-605374722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-354ee997-27cc-48f8-92c8-d104f8a9160c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-d3e17849-369b-4b61-8a8a-6f54f05a3cc9 req-8977d7b4-d36a-47f4-ad4f-3cf64e183c0d tempest-AttachVolumeTestJSON-723745895 None] attachment_update completed successfully. Jul 08 14:32:47 devstack sudo[93366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-354ee997-27cc-48f8-92c8-d104f8a9160c Jul 08 14:32:47 devstack sudo[93366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:48 devstack sudo[93366]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-94b05901-e121-4ed0-820e-c2ec3fbd0196 tempest-VolumesTransfersTest-605374722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-354ee997-27cc-48f8-92c8-d104f8a9160c" returned: 0 in 1.302s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-94b05901-e121-4ed0-820e-c2ec3fbd0196 tempest-VolumesTransfersTest-605374722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-354ee997-27cc-48f8-92c8-d104f8a9160c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:49 devstack sudo[93755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-354ee997-27cc-48f8-92c8-d104f8a9160c Jul 08 14:32:49 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:49 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-94b05901-e121-4ed0-820e-c2ec3fbd0196 tempest-VolumesTransfersTest-605374722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-354ee997-27cc-48f8-92c8-d104f8a9160c" returned: 0 in 0.875s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-94b05901-e121-4ed0-820e-c2ec3fbd0196 tempest-VolumesTransfersTest-605374722 None] Lock "cinder-quobyte-354ee997-27cc-48f8-92c8-d104f8a9160c" released by "delete_volume" :: held 2.244s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:49 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-94b05901-e121-4ed0-820e-c2ec3fbd0196 tempest-VolumesTransfersTest-605374722 None] Created reservations ['ba5a00bc-8ed2-494e-8bde-b60b94750ce3', 'f1d042b3-9203-41c2-a982-539907e614a4', '4ba8d264-c2b6-4fdc-b6a4-bfd422cde5bd', '6607e455-c033-4397-8179-3dd97b4141c4'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:32:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-94b05901-e121-4ed0-820e-c2ec3fbd0196 tempest-VolumesTransfersTest-605374722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-94b05901-e121-4ed0-820e-c2ec3fbd0196 tempest-VolumesTransfersTest-605374722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-94b05901-e121-4ed0-820e-c2ec3fbd0196 tempest-VolumesTransfersTest-605374722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-94b05901-e121-4ed0-820e-c2ec3fbd0196 tempest-VolumesTransfersTest-605374722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-94b05901-e121-4ed0-820e-c2ec3fbd0196 tempest-VolumesTransfersTest-605374722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-94b05901-e121-4ed0-820e-c2ec3fbd0196 tempest-VolumesTransfersTest-605374722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:50 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:32:50 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:50 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-94b05901-e121-4ed0-820e-c2ec3fbd0196 tempest-VolumesTransfersTest-605374722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.764s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:50 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-94b05901-e121-4ed0-820e-c2ec3fbd0196 tempest-VolumesTransfersTest-605374722 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:32:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-94b05901-e121-4ed0-820e-c2ec3fbd0196 tempest-VolumesTransfersTest-605374722 None] Deleted volume successfully. Jul 08 14:32:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-94b05901-e121-4ed0-820e-c2ec3fbd0196 tempest-VolumesTransfersTest-605374722 None] Lock "cinder-354ee997-27cc-48f8-92c8-d104f8a9160c-delete_volume" released by "delete_volume" :: held 3.376s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:32:52 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:32:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Flow 'volume_create_manager' (e0afd3c1-7e3d-497b-a539-639ce37c13a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18bc4c0-e4cf-4bc0-b58f-eb90f640660e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18bc4c0-e4cf-4bc0-b58f-eb90f640660e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-641979530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ceb7901-a572-4d1a-9182-109d6131f348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48483ad562f441158d14a2eee3013bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:52Z,use_quota=True,user_id='f706d1c701ea4e67a1a6571345e20a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e17a03-adb2-4d90-8381-2ea22d607dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e17a03-adb2-4d90-8381-2ea22d607dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7496f2c2-b646-48e8-9fbc-7f7dbb55123d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7496f2c2-b646-48e8-9fbc-7f7dbb55123d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ceb7901-a572-4d1a-9182-109d6131f348', 'volume_name': 'volume-4ceb7901-a572-4d1a-9182-109d6131f348', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b23890-364f-422c-ad4f-53a0fd29373b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b23890-364f-422c-ad4f-53a0fd29373b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552cd4d3-b4b0-4da9-a474-4269e80f0190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:52 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Volume 4ceb7901-a572-4d1a-9182-109d6131f348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ceb7901-a572-4d1a-9182-109d6131f348', 'volume_size': 1} Jul 08 14:32:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-641979530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ceb7901-a572-4d1a-9182-109d6131f348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48483ad562f441158d14a2eee3013bdf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:52Z,use_quota=True,user_id='f706d1c701ea4e67a1a6571345e20a9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:32:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Creating volume 4ceb7901-a572-4d1a-9182-109d6131f348 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:32:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:32:52 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:32:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4ceb7901-a572-4d1a-9182-109d6131f348 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:52 devstack sudo[93771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4ceb7901-a572-4d1a-9182-109d6131f348 1073741824 Jul 08 14:32:52 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:53 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4ceb7901-a572-4d1a-9182-109d6131f348 1073741824" returned: 0 in 1.361s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4ceb7901-a572-4d1a-9182-109d6131f348 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:53 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4ceb7901-a572-4d1a-9182-109d6131f348 Jul 08 14:32:53 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:54 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4ceb7901-a572-4d1a-9182-109d6131f348" returned: 0 in 0.876s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] <== create_volume: return (2289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:32:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.292s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (552cd4d3-b4b0-4da9-a474-4269e80f0190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ceb7901-a572-4d1a-9182-109d6131f348', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6fb76c-2474-461a-9491-95289e4e552c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:54 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Volume volume-4ceb7901-a572-4d1a-9182-109d6131f348 (4ceb7901-a572-4d1a-9182-109d6131f348): created successfully Jul 08 14:32:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6fb76c-2474-461a-9491-95289e4e552c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Flow 'volume_create_manager' (e0afd3c1-7e3d-497b-a539-639ce37c13a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:54 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-992967ea-846e-4722-804b-cb304b14dba1 tempest-AttachVolumeTestJSON-723745895 None] Created volume successfully. Jul 08 14:32:56 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:32:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Flow 'volume_create_manager' (ee9f268b-3371-4a90-82c1-5769faf48259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf385b79-bede-4655-8147-40d99e92d0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf385b79-bede-4655-8147-40d99e92d0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-423449804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d597e29-f87d-4459-920d-6dee934d354e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986b1ce7736b4fbda6ac6fe0c3d5de21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:56Z,use_quota=True,user_id='b72161dd2c7e4c80a581eca4925908e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379d767d-fafc-427a-9aa6-0710fdead3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379d767d-fafc-427a-9aa6-0710fdead3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c2bbff8-8d15-40d4-bf1b-f0144f5edd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c2bbff8-8d15-40d4-bf1b-f0144f5edd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d597e29-f87d-4459-920d-6dee934d354e', 'volume_name': 'volume-7d597e29-f87d-4459-920d-6dee934d354e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e7a7b5-b5a0-4410-89af-0b32d70e3f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1e7a7b5-b5a0-4410-89af-0b32d70e3f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eb967d1-110a-480e-bb0a-c7b9b7b2099d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:56 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Volume 7d597e29-f87d-4459-920d-6dee934d354e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d597e29-f87d-4459-920d-6dee934d354e', 'volume_size': 1} Jul 08 14:32:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-423449804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d597e29-f87d-4459-920d-6dee934d354e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='986b1ce7736b4fbda6ac6fe0c3d5de21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:32:56Z,use_quota=True,user_id='b72161dd2c7e4c80a581eca4925908e4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:32:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Creating volume 7d597e29-f87d-4459-920d-6dee934d354e {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:32:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:32:56 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:32:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7d597e29-f87d-4459-920d-6dee934d354e 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:56 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7d597e29-f87d-4459-920d-6dee934d354e 1073741824 Jul 08 14:32:56 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:57 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7d597e29-f87d-4459-920d-6dee934d354e 1073741824" returned: 0 in 1.095s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7d597e29-f87d-4459-920d-6dee934d354e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:57 devstack sudo[93792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7d597e29-f87d-4459-920d-6dee934d354e Jul 08 14:32:57 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:58 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root Jul 08 14:32:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7d597e29-f87d-4459-920d-6dee934d354e" returned: 0 in 0.874s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:32:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] <== create_volume: return (2029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:32:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.031s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eb967d1-110a-480e-bb0a-c7b9b7b2099d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d597e29-f87d-4459-920d-6dee934d354e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e84c51-8735-46e9-a2ce-81ea3cb199cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:32:58 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Volume volume-7d597e29-f87d-4459-920d-6dee934d354e (7d597e29-f87d-4459-920d-6dee934d354e): created successfully Jul 08 14:32:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e84c51-8735-46e9-a2ce-81ea3cb199cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:32:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Flow 'volume_create_manager' (ee9f268b-3371-4a90-82c1-5769faf48259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:32:58 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6db70b45-2f7a-4637-a58c-266c5ec90c0d tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Created volume successfully. Jul 08 14:32:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-104323ef-3ce2-48bd-8bd2-f1cb24ecb608 req-3067556c-ec7d-40dc-9f18-59213a590ccf tempest-AttachVolumeTestJSON-723745895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-104323ef-3ce2-48bd-8bd2-f1cb24ecb608 req-3067556c-ec7d-40dc-9f18-59213a590ccf tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:58 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe6d517-cdbd-467b-b096-bfcef6de3e67]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:32:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-104323ef-3ce2-48bd-8bd2-f1cb24ecb608 req-3067556c-ec7d-40dc-9f18-59213a590ccf tempest-AttachVolumeTestJSON-723745895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4ceb7901-a572-4d1a-9182-109d6131f348 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:59 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4ceb7901-a572-4d1a-9182-109d6131f348 Jul 08 14:32:59 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:32:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:32:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:32:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:32:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:32:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:32:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:32:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:32:59 devstack sudo[93806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:32:59 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:00 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-104323ef-3ce2-48bd-8bd2-f1cb24ecb608 req-3067556c-ec7d-40dc-9f18-59213a590ccf tempest-AttachVolumeTestJSON-723745895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4ceb7901-a572-4d1a-9182-109d6131f348" returned: 0 in 1.156s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-104323ef-3ce2-48bd-8bd2-f1cb24ecb608 req-3067556c-ec7d-40dc-9f18-59213a590ccf tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.178s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:00 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.929s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:33:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:33:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 8 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:33:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:33:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-104323ef-3ce2-48bd-8bd2-f1cb24ecb608 req-3067556c-ec7d-40dc-9f18-59213a590ccf tempest-AttachVolumeTestJSON-723745895 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad', 'name': 'volume-4ceb7901-a572-4d1a-9182-109d6131f348', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f611e8d5-fff5-4b15-9703-ec1c6a4e9499', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:33:00 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-104323ef-3ce2-48bd-8bd2-f1cb24ecb608 req-3067556c-ec7d-40dc-9f18-59213a590ccf tempest-AttachVolumeTestJSON-723745895 None] attachment_update completed successfully. Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b4a77993-4590-4ef3-bb6e-22cafc6dc1e8 tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Acquiring lock "cinder-7d597e29-f87d-4459-920d-6dee934d354e-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b4a77993-4590-4ef3-bb6e-22cafc6dc1e8 tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Lock "cinder-7d597e29-f87d-4459-920d-6dee934d354e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b4a77993-4590-4ef3-bb6e-22cafc6dc1e8 tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Acquiring lock "cinder-quobyte-7d597e29-f87d-4459-920d-6dee934d354e" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b4a77993-4590-4ef3-bb6e-22cafc6dc1e8 tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Lock "cinder-quobyte-7d597e29-f87d-4459-920d-6dee934d354e" acquired by "delete_volume" :: waited 0.033s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[73026c0d-04ac-4dca-9a3d-16e9f87df289]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b4a77993-4590-4ef3-bb6e-22cafc6dc1e8 tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7d597e29-f87d-4459-920d-6dee934d354e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:01 devstack sudo[93815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7d597e29-f87d-4459-920d-6dee934d354e Jul 08 14:33:01 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Flow 'volume_create_manager' (98f19593-a9e4-4eff-b491-7d52e80b831f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e21ad47-134d-4e08-9b9a-273b20c4dc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e21ad47-134d-4e08-9b9a-273b20c4dc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1029124360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d964c6bb-5d38-4680-aac4-8b3d959459ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f389bd1c22849f898814c3f9d66c1d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:33:02Z,use_quota=True,user_id='ce96d419a5f5426ba5382f85eca6fe5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34830860-f1e5-4f8c-a0a4-2674b9af7797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34830860-f1e5-4f8c-a0a4-2674b9af7797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b412835-c1b3-42f7-8b08-9bac364e5cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b412835-c1b3-42f7-8b08-9bac364e5cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd964c6bb-5d38-4680-aac4-8b3d959459ed', 'volume_name': 'volume-d964c6bb-5d38-4680-aac4-8b3d959459ed', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43e08ac-0dea-4986-a73a-b2b5366112bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d43e08ac-0dea-4986-a73a-b2b5366112bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ed50e1-5d91-44da-9da2-5013e368aa48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:01 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Volume d964c6bb-5d38-4680-aac4-8b3d959459ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d964c6bb-5d38-4680-aac4-8b3d959459ed', 'volume_size': 1} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1029124360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d964c6bb-5d38-4680-aac4-8b3d959459ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f389bd1c22849f898814c3f9d66c1d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:33:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:33:02Z,use_quota=True,user_id='ce96d419a5f5426ba5382f85eca6fe5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Creating volume d964c6bb-5d38-4680-aac4-8b3d959459ed {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:33:01 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:33:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d964c6bb-5d38-4680-aac4-8b3d959459ed 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:01 devstack sudo[93817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d964c6bb-5d38-4680-aac4-8b3d959459ed 1073741824 Jul 08 14:33:01 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:02 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b4a77993-4590-4ef3-bb6e-22cafc6dc1e8 tempest-VolumeQuotasNegativeTestJSON-1352728762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7d597e29-f87d-4459-920d-6dee934d354e" returned: 0 in 1.074s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b4a77993-4590-4ef3-bb6e-22cafc6dc1e8 tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7d597e29-f87d-4459-920d-6dee934d354e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:02 devstack sudo[93822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7d597e29-f87d-4459-920d-6dee934d354e Jul 08 14:33:02 devstack sudo[93822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:03 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d964c6bb-5d38-4680-aac4-8b3d959459ed 1073741824" returned: 0 in 1.251s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d964c6bb-5d38-4680-aac4-8b3d959459ed {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:03 devstack sudo[93822]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b4a77993-4590-4ef3-bb6e-22cafc6dc1e8 tempest-VolumeQuotasNegativeTestJSON-1352728762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7d597e29-f87d-4459-920d-6dee934d354e" returned: 0 in 0.893s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:03 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d964c6bb-5d38-4680-aac4-8b3d959459ed Jul 08 14:33:03 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b4a77993-4590-4ef3-bb6e-22cafc6dc1e8 tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Lock "cinder-quobyte-7d597e29-f87d-4459-920d-6dee934d354e" released by "delete_volume" :: held 2.069s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:03 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-b4a77993-4590-4ef3-bb6e-22cafc6dc1e8 tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Created reservations ['c9139369-11f0-4623-9075-f4f8ca4eed78', '56c0ee0f-a388-43f3-885b-a6b0bbd49496', '63bff91d-2f25-44c3-94e6-47a686f068c2', '6e96acc7-c89a-41e6-b080-7d97779daba5'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:33:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b4a77993-4590-4ef3-bb6e-22cafc6dc1e8 tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b4a77993-4590-4ef3-bb6e-22cafc6dc1e8 tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b4a77993-4590-4ef3-bb6e-22cafc6dc1e8 tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b4a77993-4590-4ef3-bb6e-22cafc6dc1e8 tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b4a77993-4590-4ef3-bb6e-22cafc6dc1e8 tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b4a77993-4590-4ef3-bb6e-22cafc6dc1e8 tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:03 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:33:03 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:04 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d964c6bb-5d38-4680-aac4-8b3d959459ed" returned: 0 in 1.164s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] <== create_volume: return (2469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:33:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.472s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47ed50e1-5d91-44da-9da2-5013e368aa48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d964c6bb-5d38-4680-aac4-8b3d959459ed', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc07de3-8d4d-44f5-a14d-72f50dfae9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:04 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Volume volume-d964c6bb-5d38-4680-aac4-8b3d959459ed (d964c6bb-5d38-4680-aac4-8b3d959459ed): created successfully Jul 08 14:33:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bc07de3-8d4d-44f5-a14d-72f50dfae9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Flow 'volume_create_manager' (98f19593-a9e4-4eff-b491-7d52e80b831f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:33:04 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-40e651f5-f8b0-4252-89c6-d7aa5b2bb617 tempest-VolumesTransfersV357Test-574179506 None] Created volume successfully. Jul 08 14:33:04 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b4a77993-4590-4ef3-bb6e-22cafc6dc1e8 tempest-VolumeQuotasNegativeTestJSON-1352728762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.295s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:04 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-b4a77993-4590-4ef3-bb6e-22cafc6dc1e8 tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:33:04 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b4a77993-4590-4ef3-bb6e-22cafc6dc1e8 tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Deleted volume successfully. Jul 08 14:33:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b4a77993-4590-4ef3-bb6e-22cafc6dc1e8 tempest-VolumeQuotasNegativeTestJSON-1352728762 None] Lock "cinder-7d597e29-f87d-4459-920d-6dee934d354e-delete_volume" released by "delete_volume" :: held 3.915s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:06 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5e1f1d77-febb-4ece-a996-027543303b66 tempest-VolumesTransfersV357Test-1983421622 None] Transfer volume completed successfully. Jul 08 14:33:06 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-4953aea9-72f5-4cc3-877f-80c6d24cf278 req-1e91e975-9ff8-4c62-bcab-4d79c844e2c5 tempest-AttachVolumeTestJSON-723745895 None] Terminate volume connection completed successfully. Jul 08 14:33:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-4953aea9-72f5-4cc3-877f-80c6d24cf278 req-1e91e975-9ff8-4c62-bcab-4d79c844e2c5 tempest-AttachVolumeTestJSON-723745895 None] Deleting attachment f751ab0a-d6d8-4e25-8b98-9715b71a82ee. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:33:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-dd39e00e-e539-44c6-90d3-e4311b22a9c5 tempest-VolumesTransfersV357Test-629028970 None] Acquiring lock "cinder-d964c6bb-5d38-4680-aac4-8b3d959459ed-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-dd39e00e-e539-44c6-90d3-e4311b22a9c5 tempest-VolumesTransfersV357Test-629028970 None] Lock "cinder-d964c6bb-5d38-4680-aac4-8b3d959459ed-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-dd39e00e-e539-44c6-90d3-e4311b22a9c5 tempest-VolumesTransfersV357Test-629028970 None] Acquiring lock "cinder-quobyte-d964c6bb-5d38-4680-aac4-8b3d959459ed" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-dd39e00e-e539-44c6-90d3-e4311b22a9c5 tempest-VolumesTransfersV357Test-629028970 None] Lock "cinder-quobyte-d964c6bb-5d38-4680-aac4-8b3d959459ed" acquired by "delete_volume" :: waited 0.034s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:07 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d400a995-6d35-450d-81e5-067154bf55b5]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:33:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dd39e00e-e539-44c6-90d3-e4311b22a9c5 tempest-VolumesTransfersV357Test-629028970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d964c6bb-5d38-4680-aac4-8b3d959459ed {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:07 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d964c6bb-5d38-4680-aac4-8b3d959459ed Jul 08 14:33:07 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:08 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dd39e00e-e539-44c6-90d3-e4311b22a9c5 tempest-VolumesTransfersV357Test-629028970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d964c6bb-5d38-4680-aac4-8b3d959459ed" returned: 0 in 1.223s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dd39e00e-e539-44c6-90d3-e4311b22a9c5 tempest-VolumesTransfersV357Test-629028970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d964c6bb-5d38-4680-aac4-8b3d959459ed {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:09 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d964c6bb-5d38-4680-aac4-8b3d959459ed Jul 08 14:33:09 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:09 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-a329f93b-1746-4c6f-acd3-13088f7c1ff4 req-8ade7081-6326-40b9-aee9-501b25e7f68a tempest-AttachVolumeTestJSON-723745895 None] Terminate volume connection completed successfully. Jul 08 14:33:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-a329f93b-1746-4c6f-acd3-13088f7c1ff4 req-8ade7081-6326-40b9-aee9-501b25e7f68a tempest-AttachVolumeTestJSON-723745895 None] Deleting attachment f611e8d5-fff5-4b15-9703-ec1c6a4e9499. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:33:09 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dd39e00e-e539-44c6-90d3-e4311b22a9c5 tempest-VolumesTransfersV357Test-629028970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d964c6bb-5d38-4680-aac4-8b3d959459ed" returned: 0 in 0.991s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-dd39e00e-e539-44c6-90d3-e4311b22a9c5 tempest-VolumesTransfersV357Test-629028970 None] Lock "cinder-quobyte-d964c6bb-5d38-4680-aac4-8b3d959459ed" released by "delete_volume" :: held 2.321s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:10 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-dd39e00e-e539-44c6-90d3-e4311b22a9c5 tempest-VolumesTransfersV357Test-629028970 None] Created reservations ['6c8c534d-2298-4150-9a17-b11288a68a48', 'ce931d46-5850-41b8-b5d8-7e52eb4c0ca9', 'e8f7dc6d-2720-4481-b5b2-1b6d867efb8d', '4893373b-a460-4374-8366-e2a4e3161ec9'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:33:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dd39e00e-e539-44c6-90d3-e4311b22a9c5 tempest-VolumesTransfersV357Test-629028970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dd39e00e-e539-44c6-90d3-e4311b22a9c5 tempest-VolumesTransfersV357Test-629028970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dd39e00e-e539-44c6-90d3-e4311b22a9c5 tempest-VolumesTransfersV357Test-629028970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dd39e00e-e539-44c6-90d3-e4311b22a9c5 tempest-VolumesTransfersV357Test-629028970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dd39e00e-e539-44c6-90d3-e4311b22a9c5 tempest-VolumesTransfersV357Test-629028970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dd39e00e-e539-44c6-90d3-e4311b22a9c5 tempest-VolumesTransfersV357Test-629028970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:10 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:33:10 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:11 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dd39e00e-e539-44c6-90d3-e4311b22a9c5 tempest-VolumesTransfersV357Test-629028970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.981s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-dd39e00e-e539-44c6-90d3-e4311b22a9c5 tempest-VolumesTransfersV357Test-629028970 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:33:11 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-dd39e00e-e539-44c6-90d3-e4311b22a9c5 tempest-VolumesTransfersV357Test-629028970 None] Deleted volume successfully. Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-dd39e00e-e539-44c6-90d3-e4311b22a9c5 tempest-VolumesTransfersV357Test-629028970 None] Lock "cinder-d964c6bb-5d38-4680-aac4-8b3d959459ed-delete_volume" released by "delete_volume" :: held 3.729s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Flow 'volume_create_manager' (33c3d13f-f0c4-43c6-80fa-a755fc7be395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbaca49d-6ebc-4173-ba9d-e72323d68f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbaca49d-6ebc-4173-ba9d-e72323d68f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2070643981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ca1525d-a76e-4f7b-97c8-e84aed5a755a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f389bd1c22849f898814c3f9d66c1d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:33:12Z,use_quota=True,user_id='ce96d419a5f5426ba5382f85eca6fe5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb37c22-86cb-4d9d-95c3-4b7ffbd50da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb37c22-86cb-4d9d-95c3-4b7ffbd50da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff62b28-1b9a-4dae-8bc6-e7c0247ae673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff62b28-1b9a-4dae-8bc6-e7c0247ae673) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ca1525d-a76e-4f7b-97c8-e84aed5a755a', 'volume_name': 'volume-1ca1525d-a76e-4f7b-97c8-e84aed5a755a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464f6a2b-a15f-4d90-a324-8398c775c27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (464f6a2b-a15f-4d90-a324-8398c775c27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc066525-95b8-488d-9485-8869df8fb0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:11 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Volume 1ca1525d-a76e-4f7b-97c8-e84aed5a755a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ca1525d-a76e-4f7b-97c8-e84aed5a755a', 'volume_size': 1} Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-2070643981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ca1525d-a76e-4f7b-97c8-e84aed5a755a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f389bd1c22849f898814c3f9d66c1d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:33:12Z,use_quota=True,user_id='ce96d419a5f5426ba5382f85eca6fe5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Creating volume 1ca1525d-a76e-4f7b-97c8-e84aed5a755a {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:33:11 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:33:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ca1525d-a76e-4f7b-97c8-e84aed5a755a 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:11 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ca1525d-a76e-4f7b-97c8-e84aed5a755a 1073741824 Jul 08 14:33:11 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:13 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ca1525d-a76e-4f7b-97c8-e84aed5a755a 1073741824" returned: 0 in 1.158s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ca1525d-a76e-4f7b-97c8-e84aed5a755a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:13 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ca1525d-a76e-4f7b-97c8-e84aed5a755a Jul 08 14:33:13 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:13 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:33:13 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Flow 'volume_create_manager' (8f45e1e0-9987-4c08-ae1d-90d85c861579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:33:13 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8432dc92-ebbc-4224-a0a2-5d9d644da843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8432dc92-ebbc-4224-a0a2-5d9d644da843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1806315705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d27d0d65-8977-4abc-9abd-2d1a727e7040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbf1bc47e8ec439382410be9b57e379a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:33:14Z,use_quota=True,user_id='d4b4cebfe33f4eecba7c6e648b089ed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3f6193-7028-4309-9c15-e589c11c284a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3f6193-7028-4309-9c15-e589c11c284a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd30adc-a35c-452a-86db-f2fbb123cf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd30adc-a35c-452a-86db-f2fbb123cf22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd27d0d65-8977-4abc-9abd-2d1a727e7040', 'volume_name': 'volume-d27d0d65-8977-4abc-9abd-2d1a727e7040', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5279ca76-eb62-4567-9561-2b5c8ffbabd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5279ca76-eb62-4567-9561-2b5c8ffbabd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40db77a8-024d-462b-8b53-fc4023e45aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:14 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Volume d27d0d65-8977-4abc-9abd-2d1a727e7040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d27d0d65-8977-4abc-9abd-2d1a727e7040', 'volume_size': 1} Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:14 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ca1525d-a76e-4f7b-97c8-e84aed5a755a" returned: 0 in 1.349s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] <== create_volume: return (2567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.571s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.393s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1806315705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d27d0d65-8977-4abc-9abd-2d1a727e7040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fbf1bc47e8ec439382410be9b57e379a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:33:14Z,use_quota=True,user_id='d4b4cebfe33f4eecba7c6e648b089ed9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Creating volume d27d0d65-8977-4abc-9abd-2d1a727e7040 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:33:14 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:14 devstack sudo[93916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040 1073741824 Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc066525-95b8-488d-9485-8869df8fb0b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ca1525d-a76e-4f7b-97c8-e84aed5a755a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:14 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb6c311-902b-43ee-ba7b-60eedd78ce3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:14 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Volume volume-1ca1525d-a76e-4f7b-97c8-e84aed5a755a (1ca1525d-a76e-4f7b-97c8-e84aed5a755a): created successfully Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bb6c311-902b-43ee-ba7b-60eedd78ce3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Flow 'volume_create_manager' (33c3d13f-f0c4-43c6-80fa-a755fc7be395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:33:14 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-dcc97435-5d32-42b1-b673-fbc27bbc7bdc tempest-VolumesTransfersV357Test-574179506 None] Created volume successfully. Jul 08 14:33:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3a2a9c21-05d0-45e0-99cb-1a858bc3f9d8 tempest-VolumesTransfersV357Test-629028970 None] Acquiring lock "cinder-1ca1525d-a76e-4f7b-97c8-e84aed5a755a-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3a2a9c21-05d0-45e0-99cb-1a858bc3f9d8 tempest-VolumesTransfersV357Test-629028970 None] Lock "cinder-1ca1525d-a76e-4f7b-97c8-e84aed5a755a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3a2a9c21-05d0-45e0-99cb-1a858bc3f9d8 tempest-VolumesTransfersV357Test-629028970 None] Acquiring lock "cinder-quobyte-1ca1525d-a76e-4f7b-97c8-e84aed5a755a" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3a2a9c21-05d0-45e0-99cb-1a858bc3f9d8 tempest-VolumesTransfersV357Test-629028970 None] Lock "cinder-quobyte-1ca1525d-a76e-4f7b-97c8-e84aed5a755a" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:15 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[14df45f5-a434-46b1-9351-9c6c1ad2620f]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:33:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a2a9c21-05d0-45e0-99cb-1a858bc3f9d8 tempest-VolumesTransfersV357Test-629028970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ca1525d-a76e-4f7b-97c8-e84aed5a755a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:15 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ca1525d-a76e-4f7b-97c8-e84aed5a755a Jul 08 14:33:15 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:16 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040 1073741824" returned: 0 in 1.666s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:16 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=83,cinder:SELECT=69,cinder:DELETE=8,cinder:INSERT=15 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:33:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:16 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040 Jul 08 14:33:16 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:16 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a2a9c21-05d0-45e0-99cb-1a858bc3f9d8 tempest-VolumesTransfersV357Test-629028970 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ca1525d-a76e-4f7b-97c8-e84aed5a755a" returned: 0 in 0.971s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a2a9c21-05d0-45e0-99cb-1a858bc3f9d8 tempest-VolumesTransfersV357Test-629028970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ca1525d-a76e-4f7b-97c8-e84aed5a755a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:16 devstack sudo[93934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ca1525d-a76e-4f7b-97c8-e84aed5a755a Jul 08 14:33:16 devstack sudo[93934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:17 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040" returned: 0 in 0.843s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] <== create_volume: return (2735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:33:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.741s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40db77a8-024d-462b-8b53-fc4023e45aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d27d0d65-8977-4abc-9abd-2d1a727e7040', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9fd650c-aa8f-43fc-a79a-9cf1b730bc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:17 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Volume volume-d27d0d65-8977-4abc-9abd-2d1a727e7040 (d27d0d65-8977-4abc-9abd-2d1a727e7040): created successfully Jul 08 14:33:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9fd650c-aa8f-43fc-a79a-9cf1b730bc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Flow 'volume_create_manager' (8f45e1e0-9987-4c08-ae1d-90d85c861579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:33:17 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-67c53e5d-cd04-426d-80c8-130266f696d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Created volume successfully. Jul 08 14:33:17 devstack sudo[93934]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a2a9c21-05d0-45e0-99cb-1a858bc3f9d8 tempest-VolumesTransfersV357Test-629028970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ca1525d-a76e-4f7b-97c8-e84aed5a755a" returned: 0 in 0.780s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3a2a9c21-05d0-45e0-99cb-1a858bc3f9d8 tempest-VolumesTransfersV357Test-629028970 None] Lock "cinder-quobyte-1ca1525d-a76e-4f7b-97c8-e84aed5a755a" released by "delete_volume" :: held 1.794s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:17 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-3a2a9c21-05d0-45e0-99cb-1a858bc3f9d8 tempest-VolumesTransfersV357Test-629028970 None] Created reservations ['684b4492-9513-49bb-91a5-3465f4858aca', '59a3e4e7-d808-4db9-a9d8-967b44db8cd6', 'e7da935e-6896-4dcb-b063-06e20ed7679c', '9c239dbe-db3a-453e-9733-416dbb628699'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:33:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3a2a9c21-05d0-45e0-99cb-1a858bc3f9d8 tempest-VolumesTransfersV357Test-629028970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3a2a9c21-05d0-45e0-99cb-1a858bc3f9d8 tempest-VolumesTransfersV357Test-629028970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3a2a9c21-05d0-45e0-99cb-1a858bc3f9d8 tempest-VolumesTransfersV357Test-629028970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3a2a9c21-05d0-45e0-99cb-1a858bc3f9d8 tempest-VolumesTransfersV357Test-629028970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3a2a9c21-05d0-45e0-99cb-1a858bc3f9d8 tempest-VolumesTransfersV357Test-629028970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a2a9c21-05d0-45e0-99cb-1a858bc3f9d8 tempest-VolumesTransfersV357Test-629028970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:17 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:33:17 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-495fe2e8-0163-4e72-8e7d-9151cbd7f093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-495fe2e8-0163-4e72-8e7d-9151cbd7f093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-495fe2e8-0163-4e72-8e7d-9151cbd7f093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Creating offline snapshot 952ea5e1-bea1-4048-b6bc-0b30bd2381ac of volume d27d0d65-8977-4abc-9abd-2d1a727e7040 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:33:18 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[087ba997-cc23-4c12-ba94-38c5eeb27c2e]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:33:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-495fe2e8-0163-4e72-8e7d-9151cbd7f093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:18 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a2a9c21-05d0-45e0-99cb-1a858bc3f9d8 tempest-VolumesTransfersV357Test-629028970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.829s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:18 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-3a2a9c21-05d0-45e0-99cb-1a858bc3f9d8 tempest-VolumesTransfersV357Test-629028970 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:33:18 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3a2a9c21-05d0-45e0-99cb-1a858bc3f9d8 tempest-VolumesTransfersV357Test-629028970 None] Deleted volume successfully. Jul 08 14:33:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3a2a9c21-05d0-45e0-99cb-1a858bc3f9d8 tempest-VolumesTransfersV357Test-629028970 None] Lock "cinder-1ca1525d-a76e-4f7b-97c8-e84aed5a755a-delete_volume" released by "delete_volume" :: held 2.912s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:18 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040 Jul 08 14:33:18 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:19 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-495fe2e8-0163-4e72-8e7d-9151cbd7f093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040" returned: 0 in 1.135s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-495fe2e8-0163-4e72-8e7d-9151cbd7f093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.952ea5e1-bea1-4048-b6bc-0b30bd2381ac 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:19 devstack sudo[93946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.952ea5e1-bea1-4048-b6bc-0b30bd2381ac 1G Jul 08 14:33:19 devstack sudo[93946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:20 devstack sudo[93946]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-495fe2e8-0163-4e72-8e7d-9151cbd7f093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.952ea5e1-bea1-4048-b6bc-0b30bd2381ac 1G" returned: 0 in 1.287s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-495fe2e8-0163-4e72-8e7d-9151cbd7f093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d27d0d65-8977-4abc-9abd-2d1a727e7040 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.952ea5e1-bea1-4048-b6bc-0b30bd2381ac {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:21 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d27d0d65-8977-4abc-9abd-2d1a727e7040 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.952ea5e1-bea1-4048-b6bc-0b30bd2381ac Jul 08 14:33:21 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:22 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-495fe2e8-0163-4e72-8e7d-9151cbd7f093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d27d0d65-8977-4abc-9abd-2d1a727e7040 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.952ea5e1-bea1-4048-b6bc-0b30bd2381ac" returned: 0 in 1.184s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:22 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-495fe2e8-0163-4e72-8e7d-9151cbd7f093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.952ea5e1-bea1-4048-b6bc-0b30bd2381ac is being set with open permissions: ugo+rw Jul 08 14:33:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-495fe2e8-0163-4e72-8e7d-9151cbd7f093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.952ea5e1-bea1-4048-b6bc-0b30bd2381ac {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:22 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.952ea5e1-bea1-4048-b6bc-0b30bd2381ac Jul 08 14:33:22 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-761bb95b-65bb-485c-9781-d37b64068dc8 tempest-AttachVolumeTestJSON-723745895 None] Acquiring lock "cinder-4ceb7901-a572-4d1a-9182-109d6131f348-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-761bb95b-65bb-485c-9781-d37b64068dc8 tempest-AttachVolumeTestJSON-723745895 None] Lock "cinder-4ceb7901-a572-4d1a-9182-109d6131f348-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:22 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=72,cinder:INSERT=19,cinder:UPDATE=90,cinder:DELETE=7 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:33:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-761bb95b-65bb-485c-9781-d37b64068dc8 tempest-AttachVolumeTestJSON-723745895 None] Acquiring lock "cinder-quobyte-4ceb7901-a572-4d1a-9182-109d6131f348" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-761bb95b-65bb-485c-9781-d37b64068dc8 tempest-AttachVolumeTestJSON-723745895 None] Lock "cinder-quobyte-4ceb7901-a572-4d1a-9182-109d6131f348" acquired by "delete_volume" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:22 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eab8008-9a07-4ac4-abe7-4d3625977268]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:33:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-761bb95b-65bb-485c-9781-d37b64068dc8 tempest-AttachVolumeTestJSON-723745895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4ceb7901-a572-4d1a-9182-109d6131f348 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:22 devstack sudo[93981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4ceb7901-a572-4d1a-9182-109d6131f348 Jul 08 14:33:22 devstack sudo[93981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:23 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-495fe2e8-0163-4e72-8e7d-9151cbd7f093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.952ea5e1-bea1-4048-b6bc-0b30bd2381ac" returned: 0 in 0.890s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-495fe2e8-0163-4e72-8e7d-9151cbd7f093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:23 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.info Jul 08 14:33:23 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:23 devstack sudo[93981]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-761bb95b-65bb-485c-9781-d37b64068dc8 tempest-AttachVolumeTestJSON-723745895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4ceb7901-a572-4d1a-9182-109d6131f348" returned: 0 in 1.107s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-761bb95b-65bb-485c-9781-d37b64068dc8 tempest-AttachVolumeTestJSON-723745895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4ceb7901-a572-4d1a-9182-109d6131f348 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:23 devstack sudo[93989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4ceb7901-a572-4d1a-9182-109d6131f348 Jul 08 14:33:23 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:23 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-495fe2e8-0163-4e72-8e7d-9151cbd7f093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.info" returned: 0 in 0.847s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:23 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-495fe2e8-0163-4e72-8e7d-9151cbd7f093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.info is being set with open permissions: ugo+rw Jul 08 14:33:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-495fe2e8-0163-4e72-8e7d-9151cbd7f093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:23 devstack sudo[93992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.info Jul 08 14:33:23 devstack sudo[93992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:24 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-761bb95b-65bb-485c-9781-d37b64068dc8 tempest-AttachVolumeTestJSON-723745895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4ceb7901-a572-4d1a-9182-109d6131f348" returned: 0 in 0.824s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-761bb95b-65bb-485c-9781-d37b64068dc8 tempest-AttachVolumeTestJSON-723745895 None] Lock "cinder-quobyte-4ceb7901-a572-4d1a-9182-109d6131f348" released by "delete_volume" :: held 2.001s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:24 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-761bb95b-65bb-485c-9781-d37b64068dc8 tempest-AttachVolumeTestJSON-723745895 None] Created reservations ['0456a453-f207-4678-8694-95b143d82166', '3fcd44b3-86a4-4448-b256-18d23bcb2841', '71197c16-b2e4-42c4-a5f0-0d01446374dd', 'a29be3f4-2d67-4faf-878c-b62c1d4cbbe9'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:33:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-761bb95b-65bb-485c-9781-d37b64068dc8 tempest-AttachVolumeTestJSON-723745895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-761bb95b-65bb-485c-9781-d37b64068dc8 tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-761bb95b-65bb-485c-9781-d37b64068dc8 tempest-AttachVolumeTestJSON-723745895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-761bb95b-65bb-485c-9781-d37b64068dc8 tempest-AttachVolumeTestJSON-723745895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-761bb95b-65bb-485c-9781-d37b64068dc8 tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-761bb95b-65bb-485c-9781-d37b64068dc8 tempest-AttachVolumeTestJSON-723745895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:24 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:33:24 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-86e5ae4c-29b4-4fb2-8872-f3846eba3605 tempest-AttachVolumeTestJSON-723745895 None] Acquiring lock "cinder-ba27d933-1789-4be5-8ad0-30b7fbbf420c-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-86e5ae4c-29b4-4fb2-8872-f3846eba3605 tempest-AttachVolumeTestJSON-723745895 None] Lock "cinder-ba27d933-1789-4be5-8ad0-30b7fbbf420c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-86e5ae4c-29b4-4fb2-8872-f3846eba3605 tempest-AttachVolumeTestJSON-723745895 None] Acquiring lock "cinder-quobyte-ba27d933-1789-4be5-8ad0-30b7fbbf420c" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-86e5ae4c-29b4-4fb2-8872-f3846eba3605 tempest-AttachVolumeTestJSON-723745895 None] Lock "cinder-quobyte-ba27d933-1789-4be5-8ad0-30b7fbbf420c" acquired by "delete_volume" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:24 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68e77f4-1f90-4ba3-8800-6209ab6c71df]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:33:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-86e5ae4c-29b4-4fb2-8872-f3846eba3605 tempest-AttachVolumeTestJSON-723745895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ba27d933-1789-4be5-8ad0-30b7fbbf420c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:25 devstack sudo[93992]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-495fe2e8-0163-4e72-8e7d-9151cbd7f093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.info" returned: 0 in 1.170s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-495fe2e8-0163-4e72-8e7d-9151cbd7f093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.643s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:25 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ba27d933-1789-4be5-8ad0-30b7fbbf420c Jul 08 14:33:25 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:25 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-495fe2e8-0163-4e72-8e7d-9151cbd7f093 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Create snapshot completed successfully Jul 08 14:33:25 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-761bb95b-65bb-485c-9781-d37b64068dc8 tempest-AttachVolumeTestJSON-723745895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.006s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:25 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-761bb95b-65bb-485c-9781-d37b64068dc8 tempest-AttachVolumeTestJSON-723745895 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:33:25 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-761bb95b-65bb-485c-9781-d37b64068dc8 tempest-AttachVolumeTestJSON-723745895 None] Deleted volume successfully. Jul 08 14:33:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-761bb95b-65bb-485c-9781-d37b64068dc8 tempest-AttachVolumeTestJSON-723745895 None] Lock "cinder-4ceb7901-a572-4d1a-9182-109d6131f348-delete_volume" released by "delete_volume" :: held 3.358s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:26 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-86e5ae4c-29b4-4fb2-8872-f3846eba3605 tempest-AttachVolumeTestJSON-723745895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ba27d933-1789-4be5-8ad0-30b7fbbf420c" returned: 0 in 1.197s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-86e5ae4c-29b4-4fb2-8872-f3846eba3605 tempest-AttachVolumeTestJSON-723745895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ba27d933-1789-4be5-8ad0-30b7fbbf420c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:26 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ba27d933-1789-4be5-8ad0-30b7fbbf420c Jul 08 14:33:26 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b08fb092-2be2-42ea-a7b7-d322886ecf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Acquiring lock "cinder-952ea5e1-bea1-4048-b6bc-0b30bd2381ac-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b08fb092-2be2-42ea-a7b7-d322886ecf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Lock "cinder-952ea5e1-bea1-4048-b6bc-0b30bd2381ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b08fb092-2be2-42ea-a7b7-d322886ecf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Acquiring lock "cinder-quobyte-d27d0d65-8977-4abc-9abd-2d1a727e7040" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b08fb092-2be2-42ea-a7b7-d322886ecf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Lock "cinder-quobyte-d27d0d65-8977-4abc-9abd-2d1a727e7040" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b08fb092-2be2-42ea-a7b7-d322886ecf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Acquiring lock "cinder-quobyte-952ea5e1-bea1-4048-b6bc-0b30bd2381ac" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b08fb092-2be2-42ea-a7b7-d322886ecf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Lock "cinder-quobyte-952ea5e1-bea1-4048-b6bc-0b30bd2381ac" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b08fb092-2be2-42ea-a7b7-d322886ecf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Deleting offline snapshot 952ea5e1-bea1-4048-b6bc-0b30bd2381ac of volume d27d0d65-8977-4abc-9abd-2d1a727e7040 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:33:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b08fb092-2be2-42ea-a7b7-d322886ecf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] snapshot_file for this snap is: volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.952ea5e1-bea1-4048-b6bc-0b30bd2381ac {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:33:26 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea104af-ba6c-4d1e-aab5-ea092387ff2f]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:33:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b08fb092-2be2-42ea-a7b7-d322886ecf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.952ea5e1-bea1-4048-b6bc-0b30bd2381ac {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:27 devstack sudo[94036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.952ea5e1-bea1-4048-b6bc-0b30bd2381ac Jul 08 14:33:27 devstack sudo[94036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:27 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-86e5ae4c-29b4-4fb2-8872-f3846eba3605 tempest-AttachVolumeTestJSON-723745895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ba27d933-1789-4be5-8ad0-30b7fbbf420c" returned: 0 in 1.202s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-86e5ae4c-29b4-4fb2-8872-f3846eba3605 tempest-AttachVolumeTestJSON-723745895 None] Lock "cinder-quobyte-ba27d933-1789-4be5-8ad0-30b7fbbf420c" released by "delete_volume" :: held 2.484s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:27 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-86e5ae4c-29b4-4fb2-8872-f3846eba3605 tempest-AttachVolumeTestJSON-723745895 None] Created reservations ['325a879d-7e0c-4989-a2d8-0cfb60fb239f', '636f6017-0416-4e60-9e53-da969bf8fd54', '64f00d6b-6906-43cd-b2e1-6d6ae933706d', '2abddf42-f8e5-44df-a6da-d1274a7fbf96'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:33:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-86e5ae4c-29b4-4fb2-8872-f3846eba3605 tempest-AttachVolumeTestJSON-723745895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-86e5ae4c-29b4-4fb2-8872-f3846eba3605 tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-86e5ae4c-29b4-4fb2-8872-f3846eba3605 tempest-AttachVolumeTestJSON-723745895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-86e5ae4c-29b4-4fb2-8872-f3846eba3605 tempest-AttachVolumeTestJSON-723745895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-86e5ae4c-29b4-4fb2-8872-f3846eba3605 tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-86e5ae4c-29b4-4fb2-8872-f3846eba3605 tempest-AttachVolumeTestJSON-723745895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:27 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:33:27 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:27 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:33:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Flow 'volume_create_manager' (88f0b7eb-c565-4e44-a406-0cb6c24202b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d7b327-01ce-433e-9102-5c5bff1bde46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d7b327-01ce-433e-9102-5c5bff1bde46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1256210062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8cd88aa-0368-47ee-b813-ac814859f3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ad8f694547453db96e56cecfd02881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:33:28Z,use_quota=True,user_id='6ba9b615596a43e3ac7b97632c048ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4194eeb-3fc7-4367-b3f9-3a40727c94e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4194eeb-3fc7-4367-b3f9-3a40727c94e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb9aa01-bff2-4874-853f-43701bcf86db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bb9aa01-bff2-4874-853f-43701bcf86db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8cd88aa-0368-47ee-b813-ac814859f3aa', 'volume_name': 'volume-b8cd88aa-0368-47ee-b813-ac814859f3aa', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0296a7bc-52be-4299-a4b8-4c0334c431f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0296a7bc-52be-4299-a4b8-4c0334c431f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e964eec4-e70c-47d1-8746-aa905ad05da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:28 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Volume b8cd88aa-0368-47ee-b813-ac814859f3aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8cd88aa-0368-47ee-b813-ac814859f3aa', 'volume_size': 1} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:33:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1256210062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8cd88aa-0368-47ee-b813-ac814859f3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70ad8f694547453db96e56cecfd02881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:33:28Z,use_quota=True,user_id='6ba9b615596a43e3ac7b97632c048ac8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Creating volume b8cd88aa-0368-47ee-b813-ac814859f3aa {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:33:28 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8cd88aa-0368-47ee-b813-ac814859f3aa 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:28 devstack sudo[94063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8cd88aa-0368-47ee-b813-ac814859f3aa 1073741824 Jul 08 14:33:28 devstack sudo[94063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c12717e5-a174-4290-bebf-54915de825c4 tempest-AttachVolumeTestJSON-723745895 None] Acquiring lock "cinder-8635c3c7-2723-4a4a-b835-d686023bd89d-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c12717e5-a174-4290-bebf-54915de825c4 tempest-AttachVolumeTestJSON-723745895 None] Lock "cinder-8635c3c7-2723-4a4a-b835-d686023bd89d-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:28 devstack sudo[94036]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b08fb092-2be2-42ea-a7b7-d322886ecf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.952ea5e1-bea1-4048-b6bc-0b30bd2381ac" returned: 0 in 2.011s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b08fb092-2be2-42ea-a7b7-d322886ecf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d27d0d65-8977-4abc-9abd-2d1a727e7040(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c12717e5-a174-4290-bebf-54915de825c4 tempest-AttachVolumeTestJSON-723745895 None] Acquiring lock "cinder-quobyte-8635c3c7-2723-4a4a-b835-d686023bd89d" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5360aab-0203-49ff-af02-7832be10b6fe]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:33:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b08fb092-2be2-42ea-a7b7-d322886ecf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c12717e5-a174-4290-bebf-54915de825c4 tempest-AttachVolumeTestJSON-723745895 None] Lock "cinder-quobyte-8635c3c7-2723-4a4a-b835-d686023bd89d" acquired by "delete_volume" :: waited 0.086s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:29 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6268f7ad-d3e4-4671-8cb4-9ce2d5e37da6]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:33:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c12717e5-a174-4290-bebf-54915de825c4 tempest-AttachVolumeTestJSON-723745895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8635c3c7-2723-4a4a-b835-d686023bd89d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:29 devstack sudo[94085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040 Jul 08 14:33:29 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:29 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8635c3c7-2723-4a4a-b835-d686023bd89d Jul 08 14:33:29 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:29 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-86e5ae4c-29b4-4fb2-8872-f3846eba3605 tempest-AttachVolumeTestJSON-723745895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.512s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:29 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-86e5ae4c-29b4-4fb2-8872-f3846eba3605 tempest-AttachVolumeTestJSON-723745895 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:33:29 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-86e5ae4c-29b4-4fb2-8872-f3846eba3605 tempest-AttachVolumeTestJSON-723745895 None] Deleted volume successfully. Jul 08 14:33:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-86e5ae4c-29b4-4fb2-8872-f3846eba3605 tempest-AttachVolumeTestJSON-723745895 None] Lock "cinder-ba27d933-1789-4be5-8ad0-30b7fbbf420c-delete_volume" released by "delete_volume" :: held 4.634s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:29 devstack sudo[94063]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8cd88aa-0368-47ee-b813-ac814859f3aa 1073741824" returned: 0 in 1.601s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8cd88aa-0368-47ee-b813-ac814859f3aa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:29 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8cd88aa-0368-47ee-b813-ac814859f3aa Jul 08 14:33:29 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:30 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b08fb092-2be2-42ea-a7b7-d322886ecf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040" returned: 0 in 1.264s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b08fb092-2be2-42ea-a7b7-d322886ecf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.952ea5e1-bea1-4048-b6bc-0b30bd2381ac {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:30 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.952ea5e1-bea1-4048-b6bc-0b30bd2381ac Jul 08 14:33:30 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:30 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c12717e5-a174-4290-bebf-54915de825c4 tempest-AttachVolumeTestJSON-723745895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8635c3c7-2723-4a4a-b835-d686023bd89d" returned: 0 in 1.293s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c12717e5-a174-4290-bebf-54915de825c4 tempest-AttachVolumeTestJSON-723745895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8635c3c7-2723-4a4a-b835-d686023bd89d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:30 devstack sudo[94106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8635c3c7-2723-4a4a-b835-d686023bd89d Jul 08 14:33:30 devstack sudo[94106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:31 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8cd88aa-0368-47ee-b813-ac814859f3aa" returned: 0 in 1.345s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] <== create_volume: return (3046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:33:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.051s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e964eec4-e70c-47d1-8746-aa905ad05da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8cd88aa-0368-47ee-b813-ac814859f3aa', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f69c941-0dca-407e-9193-ce54a012d645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:31 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Volume volume-b8cd88aa-0368-47ee-b813-ac814859f3aa (b8cd88aa-0368-47ee-b813-ac814859f3aa): created successfully Jul 08 14:33:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f69c941-0dca-407e-9193-ce54a012d645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Flow 'volume_create_manager' (88f0b7eb-c565-4e44-a406-0cb6c24202b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:33:31 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c81a5f25-b147-413e-82a1-4fd005251115 tempest-VolumesNegativeTest-463339931 None] Created volume successfully. Jul 08 14:33:31 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b08fb092-2be2-42ea-a7b7-d322886ecf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.952ea5e1-bea1-4048-b6bc-0b30bd2381ac" returned: 0 in 1.424s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:31 devstack sudo[94106]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b08fb092-2be2-42ea-a7b7-d322886ecf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.952ea5e1-bea1-4048-b6bc-0b30bd2381ac {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c12717e5-a174-4290-bebf-54915de825c4 tempest-AttachVolumeTestJSON-723745895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8635c3c7-2723-4a4a-b835-d686023bd89d" returned: 0 in 1.272s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:31 devstack sudo[94115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.952ea5e1-bea1-4048-b6bc-0b30bd2381ac Jul 08 14:33:31 devstack sudo[94115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c12717e5-a174-4290-bebf-54915de825c4 tempest-AttachVolumeTestJSON-723745895 None] Lock "cinder-quobyte-8635c3c7-2723-4a4a-b835-d686023bd89d" released by "delete_volume" :: held 2.665s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:31 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-c12717e5-a174-4290-bebf-54915de825c4 tempest-AttachVolumeTestJSON-723745895 None] Created reservations ['bdf6b22a-82d3-48c2-9d7a-b339ff7f4687', '8640d67b-81f8-4858-a0da-43374ab87094', '8a034c3d-7767-43b2-9320-6e1757389552', 'eaee308d-f98e-4617-a44c-174b0e6d87db'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:33:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c12717e5-a174-4290-bebf-54915de825c4 tempest-AttachVolumeTestJSON-723745895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c12717e5-a174-4290-bebf-54915de825c4 tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c12717e5-a174-4290-bebf-54915de825c4 tempest-AttachVolumeTestJSON-723745895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c12717e5-a174-4290-bebf-54915de825c4 tempest-AttachVolumeTestJSON-723745895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c12717e5-a174-4290-bebf-54915de825c4 tempest-AttachVolumeTestJSON-723745895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c12717e5-a174-4290-bebf-54915de825c4 tempest-AttachVolumeTestJSON-723745895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:31 devstack sudo[94117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:33:31 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:32 devstack sudo[94115]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b08fb092-2be2-42ea-a7b7-d322886ecf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040.952ea5e1-bea1-4048-b6bc-0b30bd2381ac" returned: 0 in 1.213s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:32 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c12717e5-a174-4290-bebf-54915de825c4 tempest-AttachVolumeTestJSON-723745895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.089s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:32 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-c12717e5-a174-4290-bebf-54915de825c4 tempest-AttachVolumeTestJSON-723745895 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:33:32 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c12717e5-a174-4290-bebf-54915de825c4 tempest-AttachVolumeTestJSON-723745895 None] Deleted volume successfully. Jul 08 14:33:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b08fb092-2be2-42ea-a7b7-d322886ecf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Lock "cinder-quobyte-952ea5e1-bea1-4048-b6bc-0b30bd2381ac" released by "_delete_snapshot" :: held 6.192s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b08fb092-2be2-42ea-a7b7-d322886ecf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Lock "cinder-quobyte-d27d0d65-8977-4abc-9abd-2d1a727e7040" released by "delete_snapshot" :: held 6.229s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c12717e5-a174-4290-bebf-54915de825c4 tempest-AttachVolumeTestJSON-723745895 None] Lock "cinder-8635c3c7-2723-4a4a-b835-d686023bd89d-delete_volume" released by "delete_volume" :: held 4.313s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:33 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-b08fb092-2be2-42ea-a7b7-d322886ecf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Created reservations ['cd23e4c8-36ff-4f41-a972-eb7ca3fe2271', '55ae624a-7f60-4e12-b67c-135d82109989', '3e77cc9f-0151-4b70-955f-dbcc71368ce4', 'e3151e22-f2eb-4307-960c-de57f2c9f0c5'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:33:33 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b08fb092-2be2-42ea-a7b7-d322886ecf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Delete snapshot completed successfully. Jul 08 14:33:33 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b08fb092-2be2-42ea-a7b7-d322886ecf65 tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Lock "cinder-952ea5e1-bea1-4048-b6bc-0b30bd2381ac-delete_snapshot" released by "delete_snapshot" :: held 6.489s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:33 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-15cab059-149a-4b58-b44d-23282c0ceedd tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Acquiring lock "cinder-d27d0d65-8977-4abc-9abd-2d1a727e7040-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:33 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-15cab059-149a-4b58-b44d-23282c0ceedd tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Lock "cinder-d27d0d65-8977-4abc-9abd-2d1a727e7040-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:33 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-15cab059-149a-4b58-b44d-23282c0ceedd tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Acquiring lock "cinder-quobyte-d27d0d65-8977-4abc-9abd-2d1a727e7040" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:33 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-15cab059-149a-4b58-b44d-23282c0ceedd tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Lock "cinder-quobyte-d27d0d65-8977-4abc-9abd-2d1a727e7040" acquired by "delete_volume" :: waited 0.038s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:33 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf2bbb5-e0eb-44fa-a877-dc828425622c]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:33:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-15cab059-149a-4b58-b44d-23282c0ceedd tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:33 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040 Jul 08 14:33:33 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:34 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-15cab059-149a-4b58-b44d-23282c0ceedd tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040" returned: 0 in 1.062s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-15cab059-149a-4b58-b44d-23282c0ceedd tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:34 devstack sudo[94128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040 Jul 08 14:33:34 devstack sudo[94128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:35 devstack sudo[94128]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-15cab059-149a-4b58-b44d-23282c0ceedd tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d27d0d65-8977-4abc-9abd-2d1a727e7040" returned: 0 in 1.062s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-15cab059-149a-4b58-b44d-23282c0ceedd tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Lock "cinder-quobyte-d27d0d65-8977-4abc-9abd-2d1a727e7040" released by "delete_volume" :: held 2.233s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:36 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-15cab059-149a-4b58-b44d-23282c0ceedd tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Created reservations ['233ba0f8-3150-4454-8040-62bb6945e8f2', 'b9dbc01f-9721-4e69-b6a5-81d8e4bd5f90', '54b423bf-bf60-4998-b65f-deeff0ff4872', '20c63f82-c174-4881-8efe-5f6564a8e875'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:33:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-15cab059-149a-4b58-b44d-23282c0ceedd tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-15cab059-149a-4b58-b44d-23282c0ceedd tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-15cab059-149a-4b58-b44d-23282c0ceedd tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-15cab059-149a-4b58-b44d-23282c0ceedd tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-15cab059-149a-4b58-b44d-23282c0ceedd tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-15cab059-149a-4b58-b44d-23282c0ceedd tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:36 devstack sudo[94136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:33:36 devstack sudo[94136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:37 devstack sudo[94136]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-15cab059-149a-4b58-b44d-23282c0ceedd tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.447s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:37 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-15cab059-149a-4b58-b44d-23282c0ceedd tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:33:37 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-15cab059-149a-4b58-b44d-23282c0ceedd tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Deleted volume successfully. Jul 08 14:33:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-15cab059-149a-4b58-b44d-23282c0ceedd tempest-VolumeSnapshotQuotasNegativeTestJSON-1890085590 None] Lock "cinder-d27d0d65-8977-4abc-9abd-2d1a727e7040-delete_volume" released by "delete_volume" :: held 4.147s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:33:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-19e414b7-1342-4b3c-9d8a-69fd0c70bfd1 tempest-GroupSnapshotsTest-449637402 None] Group tempest-GroupSnapshotsTest-Group-1306686013: creating Jul 08 14:33:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-19e414b7-1342-4b3c-9d8a-69fd0c70bfd1 tempest-GroupSnapshotsTest-449637402 None] Group tempest-GroupSnapshotsTest-Group-1306686013: created successfully Jul 08 14:33:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-19e414b7-1342-4b3c-9d8a-69fd0c70bfd1 tempest-GroupSnapshotsTest-449637402 None] Create group completed successfully. Jul 08 14:33:46 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:33:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Flow 'volume_create_manager' (976af6d1-6b9a-4b8e-9288-9b328446e437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:33:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (866a8703-7422-4222-9acc-2a34e82aa453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (866a8703-7422-4222-9acc-2a34e82aa453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-701014805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fd22c9e5-8670-4f97-915f-79105af7f72d,host='devstack@QuobyteHD#QuobyteHD',id=d068110b-f512-4e8d-9226-6f8d81d70076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869945f21bad402fa334beba41eec722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:33:46Z,use_quota=True,user_id='2879b4c844094ee4bf2f90016538a11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(707e4da3-326c-44b0-880b-d79c128bbf7e),volume_type_id=707e4da3-326c-44b0-880b-d79c128bbf7e)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b5978d-3bff-46e4-9180-15966b0a3845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b5978d-3bff-46e4-9180-15966b0a3845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6ce2a0-3230-448a-8dcc-6a6f54e4ab18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb6ce2a0-3230-448a-8dcc-6a6f54e4ab18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd068110b-f512-4e8d-9226-6f8d81d70076', 'volume_name': 'volume-d068110b-f512-4e8d-9226-6f8d81d70076', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7615d76e-260f-44ce-9935-d44d38339bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7615d76e-260f-44ce-9935-d44d38339bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ba2ba0a-ee80-412f-a3a8-28fbd3eda9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:46 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Volume d068110b-f512-4e8d-9226-6f8d81d70076: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d068110b-f512-4e8d-9226-6f8d81d70076', 'volume_size': 1} Jul 08 14:33:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fd22c9e5-8670-4f97-915f-79105af7f72d,created_at=2026-07-08T12:33:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-701014805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fd22c9e5-8670-4f97-915f-79105af7f72d,host='devstack@QuobyteHD#QuobyteHD',id=d068110b-f512-4e8d-9226-6f8d81d70076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869945f21bad402fa334beba41eec722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:33:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:33:46Z,use_quota=True,user_id='2879b4c844094ee4bf2f90016538a11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(707e4da3-326c-44b0-880b-d79c128bbf7e),volume_type_id=707e4da3-326c-44b0-880b-d79c128bbf7e)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:33:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Creating volume d068110b-f512-4e8d-9226-6f8d81d70076 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:33:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:33:46 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:33:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:46 devstack sudo[94219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076 1073741824 Jul 08 14:33:46 devstack sudo[94219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:47 devstack sudo[94219]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076 1073741824" returned: 0 in 1.209s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:47 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076 Jul 08 14:33:47 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:48 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076" returned: 0 in 0.903s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] <== create_volume: return (2169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:33:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.172s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ba2ba0a-ee80-412f-a3a8-28fbd3eda9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d068110b-f512-4e8d-9226-6f8d81d70076', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6548d4-bcb6-4056-b7f0-702559eca8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:48 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Volume volume-d068110b-f512-4e8d-9226-6f8d81d70076 (d068110b-f512-4e8d-9226-6f8d81d70076): created successfully Jul 08 14:33:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d6548d4-bcb6-4056-b7f0-702559eca8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Flow 'volume_create_manager' (976af6d1-6b9a-4b8e-9288-9b328446e437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:33:48 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-00c68164-8fc8-42bc-8e83-67b0f4133ce6 tempest-GroupSnapshotsTest-449637402 None] Created volume successfully. Jul 08 14:33:49 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c9fb9531-8ea5-42a3-bacf-f2e31f144d70 tempest-GroupSnapshotsTest-449637402 None] GroupSnapshot 14ee8fa2-932f-4280-9dd1-e764d63b6067: creating. Jul 08 14:33:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c9fb9531-8ea5-42a3-bacf-f2e31f144d70 tempest-GroupSnapshotsTest-449637402 None] Group snapshot 14ee8fa2-932f-4280-9dd1-e764d63b6067: creating. {{(pid=87240) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 14:33:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c9fb9531-8ea5-42a3-bacf-f2e31f144d70 tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c9fb9531-8ea5-42a3-bacf-f2e31f144d70 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c9fb9531-8ea5-42a3-bacf-f2e31f144d70 tempest-GroupSnapshotsTest-449637402 None] Creating offline snapshot a12224b6-f79e-4c5a-8352-0e98070d8265 of volume d068110b-f512-4e8d-9226-6f8d81d70076 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:33:49 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3a525b-5ae3-45fd-99fd-558df4fb090a]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:33:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c9fb9531-8ea5-42a3-bacf-f2e31f144d70 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:49 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076 Jul 08 14:33:49 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:51 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c9fb9531-8ea5-42a3-bacf-f2e31f144d70 tempest-GroupSnapshotsTest-449637402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076" returned: 0 in 1.285s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c9fb9531-8ea5-42a3-bacf-f2e31f144d70 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.a12224b6-f79e-4c5a-8352-0e98070d8265 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:51 devstack sudo[94306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.a12224b6-f79e-4c5a-8352-0e98070d8265 1G Jul 08 14:33:51 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:52 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c9fb9531-8ea5-42a3-bacf-f2e31f144d70 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.a12224b6-f79e-4c5a-8352-0e98070d8265 1G" returned: 0 in 1.227s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c9fb9531-8ea5-42a3-bacf-f2e31f144d70 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d068110b-f512-4e8d-9226-6f8d81d70076 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.a12224b6-f79e-4c5a-8352-0e98070d8265 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:52 devstack sudo[94326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d068110b-f512-4e8d-9226-6f8d81d70076 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.a12224b6-f79e-4c5a-8352-0e98070d8265 Jul 08 14:33:52 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:53 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c9fb9531-8ea5-42a3-bacf-f2e31f144d70 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d068110b-f512-4e8d-9226-6f8d81d70076 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.a12224b6-f79e-4c5a-8352-0e98070d8265" returned: 0 in 1.063s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:53 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-c9fb9531-8ea5-42a3-bacf-f2e31f144d70 tempest-GroupSnapshotsTest-449637402 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.a12224b6-f79e-4c5a-8352-0e98070d8265 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:33:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c9fb9531-8ea5-42a3-bacf-f2e31f144d70 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.a12224b6-f79e-4c5a-8352-0e98070d8265 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:53 devstack sudo[94332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.a12224b6-f79e-4c5a-8352-0e98070d8265 Jul 08 14:33:53 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:54 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c9fb9531-8ea5-42a3-bacf-f2e31f144d70 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.a12224b6-f79e-4c5a-8352-0e98070d8265" returned: 0 in 1.311s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c9fb9531-8ea5-42a3-bacf-f2e31f144d70 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:54 devstack sudo[94338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.info Jul 08 14:33:54 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:55 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:33:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Flow 'volume_create_manager' (69fc6faa-9625-4834-a913-61545c74f6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:33:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90e2588-a6a3-43f4-a4db-ccb4c8db2ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90e2588-a6a3-43f4-a4db-ccb4c8db2ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-908839232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc9882a2-f66e-41c1-bdef-287c7a19261d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48e5053ea594cb8b8007ac72a44f4c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:33:56Z,use_quota=True,user_id='19d1a5694f174a8aa027528642e4ef2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb86915-a8bd-4a8a-9db7-f49b9831bb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb86915-a8bd-4a8a-9db7-f49b9831bb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd3f840-c5fc-4d08-8383-9167af695dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cd3f840-c5fc-4d08-8383-9167af695dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc9882a2-f66e-41c1-bdef-287c7a19261d', 'volume_name': 'volume-fc9882a2-f66e-41c1-bdef-287c7a19261d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db1e74b7-28a1-4602-b6aa-4ba94c6feb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db1e74b7-28a1-4602-b6aa-4ba94c6feb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb719da-e25b-436e-8a09-899ad7be909e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:55 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Volume fc9882a2-f66e-41c1-bdef-287c7a19261d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc9882a2-f66e-41c1-bdef-287c7a19261d', 'volume_size': 1} Jul 08 14:33:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:55 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c9fb9531-8ea5-42a3-bacf-f2e31f144d70 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.info" returned: 0 in 1.329s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:56 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-c9fb9531-8ea5-42a3-bacf-f2e31f144d70 tempest-GroupSnapshotsTest-449637402 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:33:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c9fb9531-8ea5-42a3-bacf-f2e31f144d70 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:56 devstack sudo[94343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.info Jul 08 14:33:56 devstack sudo[94343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:56 devstack sudo[94343]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c9fb9531-8ea5-42a3-bacf-f2e31f144d70 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.info" returned: 0 in 0.875s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c9fb9531-8ea5-42a3-bacf-f2e31f144d70 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.254s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.978s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-908839232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc9882a2-f66e-41c1-bdef-287c7a19261d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48e5053ea594cb8b8007ac72a44f4c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:33:56Z,use_quota=True,user_id='19d1a5694f174a8aa027528642e4ef2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:33:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Creating volume fc9882a2-f66e-41c1-bdef-287c7a19261d {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:33:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:33:56 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:33:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fc9882a2-f66e-41c1-bdef-287c7a19261d 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:57 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fc9882a2-f66e-41c1-bdef-287c7a19261d 1073741824 Jul 08 14:33:57 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:57 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c9fb9531-8ea5-42a3-bacf-f2e31f144d70 tempest-GroupSnapshotsTest-449637402 None] group_snapshot 14ee8fa2-932f-4280-9dd1-e764d63b6067: created successfully Jul 08 14:33:58 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fc9882a2-f66e-41c1-bdef-287c7a19261d 1073741824" returned: 0 in 1.222s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fc9882a2-f66e-41c1-bdef-287c7a19261d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:58 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fc9882a2-f66e-41c1-bdef-287c7a19261d Jul 08 14:33:58 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:59 devstack sudo[94377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:33:59 devstack sudo[94377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:33:59 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fc9882a2-f66e-41c1-bdef-287c7a19261d" returned: 0 in 1.028s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] <== create_volume: return (2311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.317s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.444s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "cinder-quobyte-a12224b6-f79e-4c5a-8352-0e98070d8265-7b3baa0d-a793-4837-8344-c35afd818bde" by "_create_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-a12224b6-f79e-4c5a-8352-0e98070d8265-7b3baa0d-a793-4837-8344-c35afd818bde" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Creating volume 7b3baa0d-a793-4837-8344-c35afd818bde from snapshot a12224b6-f79e-4c5a-8352-0e98070d8265 {{(pid=87240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "cinder-quobyte-7b3baa0d-a793-4837-8344-c35afd818bde" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-7b3baa0d-a793-4837-8344-c35afd818bde" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] snapshot: a12224b6-f79e-4c5a-8352-0e98070d8265, volume: 7b3baa0d-a793-4837-8344-c35afd818bde, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fb719da-e25b-436e-8a09-899ad7be909e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc9882a2-f66e-41c1-bdef-287c7a19261d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0a2724-d338-47be-8bfd-f5fc5b231daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3aaece2-4fbc-4f40-a1cc-e0a314dc365d]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.a12224b6-f79e-4c5a-8352-0e98070d8265 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:33:59 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Volume volume-fc9882a2-f66e-41c1-bdef-287c7a19261d (fc9882a2-f66e-41c1-bdef-287c7a19261d): created successfully Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa0a2724-d338-47be-8bfd-f5fc5b231daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:33:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Flow 'volume_create_manager' (69fc6faa-9625-4834-a913-61545c74f6df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:33:59 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-224549ce-66c1-40ce-a3d8-e2d41c964e51 tempest-AttachVolumeNegativeTest-1089741081 None] Created volume successfully. Jul 08 14:33:59 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.a12224b6-f79e-4c5a-8352-0e98070d8265 Jul 08 14:33:59 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:00 devstack sudo[94377]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.068s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:34:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:34:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 8 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:34:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:34:00 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.a12224b6-f79e-4c5a-8352-0e98070d8265" returned: 0 in 1.247s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d068110b-f512-4e8d-9226-6f8d81d70076(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:34:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076 {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:34:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:34:00 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca39930d-6e21-464f-88f8-c3b03604394b]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:34:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:00 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076 Jul 08 14:34:00 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:01 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076" returned: 0 in 0.957s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:01 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Path /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7b3baa0d-a793-4837-8344-c35afd818bde not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:34:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7b3baa0d-a793-4837-8344-c35afd818bde {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:01 devstack sudo[94395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7b3baa0d-a793-4837-8344-c35afd818bde Jul 08 14:34:01 devstack sudo[94395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-2069e9b3-3e3b-41ce-a4bc-00d870d67641 req-e4c99a1a-8a18-4283-9110-3b55f4655228 tempest-AttachVolumeNegativeTest-1089741081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:09 devstack sudo[94395]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7b3baa0d-a793-4837-8344-c35afd818bde" returned: 0 in 7.645s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:09 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[68826e66-9c5b-4c7e-9f6a-a22fba0d6085]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:34:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:09 devstack sudo[94431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076 Jul 08 14:34:09 devstack sudo[94431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:10 devstack sudo[94431]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076" returned: 0 in 1.198s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:10 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Image conversion details: src /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076, size 1024.00 MB, duration 7.65 sec, destination /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7b3baa0d-a793-4837-8344-c35afd818bde {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:34:10 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Converted 1024.00 MB image at 133.92 MB/s Jul 08 14:34:10 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7b3baa0d-a793-4837-8344-c35afd818bde is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:34:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7b3baa0d-a793-4837-8344-c35afd818bde {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:10 devstack sudo[94437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7b3baa0d-a793-4837-8344-c35afd818bde Jul 08 14:34:10 devstack sudo[94437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:11 devstack sudo[94437]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7b3baa0d-a793-4837-8344-c35afd818bde" returned: 0 in 0.990s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-7b3baa0d-a793-4837-8344-c35afd818bde" released by "_copy_volume_from_snapshot" :: held 12.177s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-a12224b6-f79e-4c5a-8352-0e98070d8265-7b3baa0d-a793-4837-8344-c35afd818bde" released by "_create_volume_from_snapshot" :: held 12.231s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.261s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-2069e9b3-3e3b-41ce-a4bc-00d870d67641 req-e4c99a1a-8a18-4283-9110-3b55f4655228 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.238s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:11 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18136a5-d8b9-4c43-8310-de48e641cd99]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:34:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-2069e9b3-3e3b-41ce-a4bc-00d870d67641 req-e4c99a1a-8a18-4283-9110-3b55f4655228 tempest-AttachVolumeNegativeTest-1089741081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fc9882a2-f66e-41c1-bdef-287c7a19261d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:11 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ea018b57-541b-4077-b97b-73a90a1b752e tempest-GroupSnapshotsTest-449637402 None] Create group from source-snapshot-14ee8fa2-932f-4280-9dd1-e764d63b6067 completed successfully. Jul 08 14:34:11 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fc9882a2-f66e-41c1-bdef-287c7a19261d Jul 08 14:34:11 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:12 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-2069e9b3-3e3b-41ce-a4bc-00d870d67641 req-e4c99a1a-8a18-4283-9110-3b55f4655228 tempest-AttachVolumeNegativeTest-1089741081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fc9882a2-f66e-41c1-bdef-287c7a19261d" returned: 0 in 1.160s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-2069e9b3-3e3b-41ce-a4bc-00d870d67641 req-e4c99a1a-8a18-4283-9110-3b55f4655228 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.197s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-2069e9b3-3e3b-41ce-a4bc-00d870d67641 req-e4c99a1a-8a18-4283-9110-3b55f4655228 tempest-AttachVolumeNegativeTest-1089741081 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad', 'name': 'volume-fc9882a2-f66e-41c1-bdef-287c7a19261d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00442aec-d23a-41b6-84f8-a9cd7a0404e9', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:34:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-12cc883b-c987-46ec-8e15-feb0fc6bb9b6 tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "cinder-quobyte-7b3baa0d-a793-4837-8344-c35afd818bde" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:34:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-12cc883b-c987-46ec-8e15-feb0fc6bb9b6 tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-7b3baa0d-a793-4837-8344-c35afd818bde" acquired by "delete_volume" :: waited 0.035s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:34:12 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-2069e9b3-3e3b-41ce-a4bc-00d870d67641 req-e4c99a1a-8a18-4283-9110-3b55f4655228 tempest-AttachVolumeNegativeTest-1089741081 None] attachment_update completed successfully. Jul 08 14:34:12 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[970aa672-db34-4048-80fb-a6c2f7a85cdf]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:34:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-12cc883b-c987-46ec-8e15-feb0fc6bb9b6 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7b3baa0d-a793-4837-8344-c35afd818bde {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:13 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7b3baa0d-a793-4837-8344-c35afd818bde Jul 08 14:34:13 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:14 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-12cc883b-c987-46ec-8e15-feb0fc6bb9b6 tempest-GroupSnapshotsTest-449637402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7b3baa0d-a793-4837-8344-c35afd818bde" returned: 0 in 1.227s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-12cc883b-c987-46ec-8e15-feb0fc6bb9b6 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7b3baa0d-a793-4837-8344-c35afd818bde {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:14 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7b3baa0d-a793-4837-8344-c35afd818bde Jul 08 14:34:14 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:15 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-12cc883b-c987-46ec-8e15-feb0fc6bb9b6 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7b3baa0d-a793-4837-8344-c35afd818bde" returned: 0 in 0.915s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-12cc883b-c987-46ec-8e15-feb0fc6bb9b6 tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-7b3baa0d-a793-4837-8344-c35afd818bde" released by "delete_volume" :: held 2.207s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:15 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-12cc883b-c987-46ec-8e15-feb0fc6bb9b6 tempest-GroupSnapshotsTest-449637402 None] Created reservations ['0d6da9d4-11c4-42dd-a6f0-a1992f1e1bc4'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:34:15 devstack cinder-volume[87240]: WARNING cinder.quota [None req-12cc883b-c987-46ec-8e15-feb0fc6bb9b6 tempest-GroupSnapshotsTest-449637402 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-574269904 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-574269904, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:34:15 devstack cinder-volume[87240]: WARNING cinder.quota [None req-12cc883b-c987-46ec-8e15-feb0fc6bb9b6 tempest-GroupSnapshotsTest-449637402 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-574269904 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-574269904, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:34:15 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-12cc883b-c987-46ec-8e15-feb0fc6bb9b6 tempest-GroupSnapshotsTest-449637402 None] Created reservations ['04700878-d84b-4710-967f-1d214d2a0330', 'ba2b9e1b-08c2-4107-9ed0-b9edeb6a5287', 'fc72c0f4-cca6-4309-a085-76b3d0f910ea', '90801e48-fdb6-49b3-8e5a-33d5d1be7786'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:34:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-12cc883b-c987-46ec-8e15-feb0fc6bb9b6 tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-12cc883b-c987-46ec-8e15-feb0fc6bb9b6 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-12cc883b-c987-46ec-8e15-feb0fc6bb9b6 tempest-GroupSnapshotsTest-449637402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-12cc883b-c987-46ec-8e15-feb0fc6bb9b6 tempest-GroupSnapshotsTest-449637402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-12cc883b-c987-46ec-8e15-feb0fc6bb9b6 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-12cc883b-c987-46ec-8e15-feb0fc6bb9b6 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:15 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:34:15 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:15 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b00eb550-ff7a-4cc3-a299-b54824f0dbc9 tempest-GroupSnapshotsTest-449637402 None] group_snapshot 14ee8fa2-932f-4280-9dd1-e764d63b6067: deleting Jul 08 14:34:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b00eb550-ff7a-4cc3-a299-b54824f0dbc9 tempest-GroupSnapshotsTest-449637402 None] group_snapshot 14ee8fa2-932f-4280-9dd1-e764d63b6067: deleting {{(pid=87240) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 14:34:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b00eb550-ff7a-4cc3-a299-b54824f0dbc9 tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "cinder-quobyte-d068110b-f512-4e8d-9226-6f8d81d70076" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:34:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b00eb550-ff7a-4cc3-a299-b54824f0dbc9 tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-d068110b-f512-4e8d-9226-6f8d81d70076" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:34:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b00eb550-ff7a-4cc3-a299-b54824f0dbc9 tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "cinder-quobyte-a12224b6-f79e-4c5a-8352-0e98070d8265" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:34:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b00eb550-ff7a-4cc3-a299-b54824f0dbc9 tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-a12224b6-f79e-4c5a-8352-0e98070d8265" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:34:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b00eb550-ff7a-4cc3-a299-b54824f0dbc9 tempest-GroupSnapshotsTest-449637402 None] Deleting offline snapshot a12224b6-f79e-4c5a-8352-0e98070d8265 of volume d068110b-f512-4e8d-9226-6f8d81d70076 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:34:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b00eb550-ff7a-4cc3-a299-b54824f0dbc9 tempest-GroupSnapshotsTest-449637402 None] snapshot_file for this snap is: volume-d068110b-f512-4e8d-9226-6f8d81d70076.a12224b6-f79e-4c5a-8352-0e98070d8265 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:34:15 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[befb05ea-3f0d-4569-b80f-2eb9f91df446]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:34:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b00eb550-ff7a-4cc3-a299-b54824f0dbc9 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.a12224b6-f79e-4c5a-8352-0e98070d8265 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:16 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.a12224b6-f79e-4c5a-8352-0e98070d8265 Jul 08 14:34:16 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:16 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-12cc883b-c987-46ec-8e15-feb0fc6bb9b6 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.337s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:16 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-12cc883b-c987-46ec-8e15-feb0fc6bb9b6 tempest-GroupSnapshotsTest-449637402 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:34:16 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-12cc883b-c987-46ec-8e15-feb0fc6bb9b6 tempest-GroupSnapshotsTest-449637402 None] Delete group completed successfully. Jul 08 14:34:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2578963c-7245-43ae-ac85-e929bfc4cdf0 tempest-VolumesNegativeTest-463339931 None] Acquiring lock "cinder-b8cd88aa-0368-47ee-b813-ac814859f3aa-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:34:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2578963c-7245-43ae-ac85-e929bfc4cdf0 tempest-VolumesNegativeTest-463339931 None] Lock "cinder-b8cd88aa-0368-47ee-b813-ac814859f3aa-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:34:16 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=78,cinder:DELETE=3,cinder:SELECT=71,cinder:INSERT=19 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:34:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2578963c-7245-43ae-ac85-e929bfc4cdf0 tempest-VolumesNegativeTest-463339931 None] Acquiring lock "cinder-quobyte-b8cd88aa-0368-47ee-b813-ac814859f3aa" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:34:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2578963c-7245-43ae-ac85-e929bfc4cdf0 tempest-VolumesNegativeTest-463339931 None] Lock "cinder-quobyte-b8cd88aa-0368-47ee-b813-ac814859f3aa" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:34:17 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87aa1c3-00bc-4002-ab06-974a11e61ae1]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:34:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2578963c-7245-43ae-ac85-e929bfc4cdf0 tempest-VolumesNegativeTest-463339931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8cd88aa-0368-47ee-b813-ac814859f3aa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:17 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8cd88aa-0368-47ee-b813-ac814859f3aa Jul 08 14:34:17 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:17 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b00eb550-ff7a-4cc3-a299-b54824f0dbc9 tempest-GroupSnapshotsTest-449637402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.a12224b6-f79e-4c5a-8352-0e98070d8265" returned: 0 in 1.497s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b00eb550-ff7a-4cc3-a299-b54824f0dbc9 tempest-GroupSnapshotsTest-449637402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d068110b-f512-4e8d-9226-6f8d81d70076(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:34:17 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4094070-4943-4c83-af7d-28e40ce4c732]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:34:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b00eb550-ff7a-4cc3-a299-b54824f0dbc9 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:17 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076 Jul 08 14:34:17 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:18 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2578963c-7245-43ae-ac85-e929bfc4cdf0 tempest-VolumesNegativeTest-463339931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8cd88aa-0368-47ee-b813-ac814859f3aa" returned: 0 in 1.090s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2578963c-7245-43ae-ac85-e929bfc4cdf0 tempest-VolumesNegativeTest-463339931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8cd88aa-0368-47ee-b813-ac814859f3aa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:18 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8cd88aa-0368-47ee-b813-ac814859f3aa Jul 08 14:34:18 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:18 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b00eb550-ff7a-4cc3-a299-b54824f0dbc9 tempest-GroupSnapshotsTest-449637402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076" returned: 0 in 1.273s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b00eb550-ff7a-4cc3-a299-b54824f0dbc9 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.a12224b6-f79e-4c5a-8352-0e98070d8265 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:18 devstack sudo[94858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.a12224b6-f79e-4c5a-8352-0e98070d8265 Jul 08 14:34:18 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:19 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2578963c-7245-43ae-ac85-e929bfc4cdf0 tempest-VolumesNegativeTest-463339931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8cd88aa-0368-47ee-b813-ac814859f3aa" returned: 0 in 0.896s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2578963c-7245-43ae-ac85-e929bfc4cdf0 tempest-VolumesNegativeTest-463339931 None] Lock "cinder-quobyte-b8cd88aa-0368-47ee-b813-ac814859f3aa" released by "delete_volume" :: held 2.061s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:19 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-2578963c-7245-43ae-ac85-e929bfc4cdf0 tempest-VolumesNegativeTest-463339931 None] Created reservations ['5a61ea37-480d-46fd-a010-23dd4676b01e', 'f4e1f8f6-5e02-4130-be82-f01d1eb015ee', '975b7eb0-a549-4c95-bd9e-2c6ab5769a10', 'eedbb3cf-2b48-4506-b3fe-f6c7a5f1bfa0'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:34:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2578963c-7245-43ae-ac85-e929bfc4cdf0 tempest-VolumesNegativeTest-463339931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2578963c-7245-43ae-ac85-e929bfc4cdf0 tempest-VolumesNegativeTest-463339931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2578963c-7245-43ae-ac85-e929bfc4cdf0 tempest-VolumesNegativeTest-463339931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2578963c-7245-43ae-ac85-e929bfc4cdf0 tempest-VolumesNegativeTest-463339931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2578963c-7245-43ae-ac85-e929bfc4cdf0 tempest-VolumesNegativeTest-463339931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2578963c-7245-43ae-ac85-e929bfc4cdf0 tempest-VolumesNegativeTest-463339931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:19 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:34:19 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:19 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b00eb550-ff7a-4cc3-a299-b54824f0dbc9 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.a12224b6-f79e-4c5a-8352-0e98070d8265" returned: 0 in 1.196s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b00eb550-ff7a-4cc3-a299-b54824f0dbc9 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.a12224b6-f79e-4c5a-8352-0e98070d8265 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:19 devstack sudo[94867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.a12224b6-f79e-4c5a-8352-0e98070d8265 Jul 08 14:34:19 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:20 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2578963c-7245-43ae-ac85-e929bfc4cdf0 tempest-VolumesNegativeTest-463339931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.081s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:20 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-2578963c-7245-43ae-ac85-e929bfc4cdf0 tempest-VolumesNegativeTest-463339931 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:34:20 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2578963c-7245-43ae-ac85-e929bfc4cdf0 tempest-VolumesNegativeTest-463339931 None] Deleted volume successfully. Jul 08 14:34:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2578963c-7245-43ae-ac85-e929bfc4cdf0 tempest-VolumesNegativeTest-463339931 None] Lock "cinder-b8cd88aa-0368-47ee-b813-ac814859f3aa-delete_volume" released by "delete_volume" :: held 3.846s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:21 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b00eb550-ff7a-4cc3-a299-b54824f0dbc9 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076.a12224b6-f79e-4c5a-8352-0e98070d8265" returned: 0 in 1.214s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b00eb550-ff7a-4cc3-a299-b54824f0dbc9 tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-a12224b6-f79e-4c5a-8352-0e98070d8265" released by "_delete_snapshot" :: held 5.322s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b00eb550-ff7a-4cc3-a299-b54824f0dbc9 tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-d068110b-f512-4e8d-9226-6f8d81d70076" released by "delete_snapshot" :: held 5.364s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:21 devstack cinder-volume[87240]: WARNING cinder.quota [None req-b00eb550-ff7a-4cc3-a299-b54824f0dbc9 tempest-GroupSnapshotsTest-449637402 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-574269904 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-574269904, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:34:21 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-b00eb550-ff7a-4cc3-a299-b54824f0dbc9 tempest-GroupSnapshotsTest-449637402 None] Created reservations ['4ff46b25-49f9-463a-9a92-62acaf703b28', '3936e5d8-bf2e-4209-b998-0d9e1706c08c', 'c9534f7e-9059-4327-88d9-fcfacb07dd7f', 'b2467cb3-61a6-4b91-a9d2-2be43faa29d9'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:34:21 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b00eb550-ff7a-4cc3-a299-b54824f0dbc9 tempest-GroupSnapshotsTest-449637402 None] group_snapshot 14ee8fa2-932f-4280-9dd1-e764d63b6067: deleted successfully Jul 08 14:34:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b0214895-228e-4f59-8bba-1f6b4a246c36 tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "cinder-quobyte-d068110b-f512-4e8d-9226-6f8d81d70076" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:34:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b0214895-228e-4f59-8bba-1f6b4a246c36 tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-d068110b-f512-4e8d-9226-6f8d81d70076" acquired by "delete_volume" :: waited 0.032s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:34:22 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d2674a-e9d4-449c-8bae-8def0056ce16]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:34:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b0214895-228e-4f59-8bba-1f6b4a246c36 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:22 devstack sudo[94874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076 Jul 08 14:34:22 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:23 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b0214895-228e-4f59-8bba-1f6b4a246c36 tempest-GroupSnapshotsTest-449637402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076" returned: 0 in 1.112s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b0214895-228e-4f59-8bba-1f6b4a246c36 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:23 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076 Jul 08 14:34:23 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:24 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b0214895-228e-4f59-8bba-1f6b4a246c36 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d068110b-f512-4e8d-9226-6f8d81d70076" returned: 0 in 1.037s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b0214895-228e-4f59-8bba-1f6b4a246c36 tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-d068110b-f512-4e8d-9226-6f8d81d70076" released by "delete_volume" :: held 2.288s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:24 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=71,cinder:INSERT=19,cinder:UPDATE=78,cinder:DELETE=6 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:34:24 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-b0214895-228e-4f59-8bba-1f6b4a246c36 tempest-GroupSnapshotsTest-449637402 None] Created reservations ['6272111f-bce6-4c2a-9ad4-7cead7085daa'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:34:24 devstack cinder-volume[87240]: WARNING cinder.db.api [None req-b0214895-228e-4f59-8bba-1f6b4a246c36 tempest-GroupSnapshotsTest-449637402 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-574269904'] Jul 08 14:34:24 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-b0214895-228e-4f59-8bba-1f6b4a246c36 tempest-GroupSnapshotsTest-449637402 None] Created reservations ['faa0a8f1-f434-40ba-a57b-ac6fc5b82c8d', '7342c6f2-6375-4a64-ae35-4dc2265a32a5', '116c93bf-22a4-44b8-8a37-fd25820aae57', 'c35c8fba-e343-4da6-a01b-e8b651feaaba'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:34:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b0214895-228e-4f59-8bba-1f6b4a246c36 tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b0214895-228e-4f59-8bba-1f6b4a246c36 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b0214895-228e-4f59-8bba-1f6b4a246c36 tempest-GroupSnapshotsTest-449637402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b0214895-228e-4f59-8bba-1f6b4a246c36 tempest-GroupSnapshotsTest-449637402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b0214895-228e-4f59-8bba-1f6b4a246c36 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b0214895-228e-4f59-8bba-1f6b4a246c36 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:24 devstack sudo[94886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:34:24 devstack sudo[94886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Flow 'volume_create_manager' (e87bc452-beb5-48db-acb1-920aeed29d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a8ee2d-781d-4082-82c3-0bea2c9aee51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5a8ee2d-781d-4082-82c3-0bea2c9aee51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1686469629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422deb14-5724-44e2-826b-64ff257828f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd52fafe65e24c0aa5cfd8097a87c1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:25Z,use_quota=True,user_id='685f0a4425874c5dbd86a927cd75cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb73f5d-8a25-4d88-8098-6f0201c30613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb73f5d-8a25-4d88-8098-6f0201c30613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb3bde9-8a11-4caf-a171-a7bb5e3b6cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cb3bde9-8a11-4caf-a171-a7bb5e3b6cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '422deb14-5724-44e2-826b-64ff257828f5', 'volume_name': 'volume-422deb14-5724-44e2-826b-64ff257828f5', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d098b61-c7de-4438-bc40-e57f1bb8a38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d098b61-c7de-4438-bc40-e57f1bb8a38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df50e0da-b05e-44f8-b07e-917f332ac41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:25 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Volume 422deb14-5724-44e2-826b-64ff257828f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-422deb14-5724-44e2-826b-64ff257828f5', 'volume_size': 1} Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1686469629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422deb14-5724-44e2-826b-64ff257828f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd52fafe65e24c0aa5cfd8097a87c1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:25Z,use_quota=True,user_id='685f0a4425874c5dbd86a927cd75cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Creating volume 422deb14-5724-44e2-826b-64ff257828f5 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:34:25 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:25 devstack sudo[94888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5 1073741824 Jul 08 14:34:25 devstack sudo[94888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:25 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fb398c03-bb6e-414e-88b7-c845f0670fd4 tempest-GroupSnapshotsTest-449637402 None] Group tempest-GroupSnapshotsTest-Group-1423730067: creating Jul 08 14:34:25 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fb398c03-bb6e-414e-88b7-c845f0670fd4 tempest-GroupSnapshotsTest-449637402 None] Group tempest-GroupSnapshotsTest-Group-1423730067: created successfully Jul 08 14:34:25 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fb398c03-bb6e-414e-88b7-c845f0670fd4 tempest-GroupSnapshotsTest-449637402 None] Create group completed successfully. Jul 08 14:34:25 devstack sudo[94886]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b0214895-228e-4f59-8bba-1f6b4a246c36 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.274s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:25 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-b0214895-228e-4f59-8bba-1f6b4a246c36 tempest-GroupSnapshotsTest-449637402 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:34:25 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b0214895-228e-4f59-8bba-1f6b4a246c36 tempest-GroupSnapshotsTest-449637402 None] Delete group completed successfully. Jul 08 14:34:26 devstack sudo[94888]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5 1073741824" returned: 0 in 1.190s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:26 devstack sudo[94895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5 Jul 08 14:34:26 devstack sudo[94895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Flow 'volume_create_manager' (9a069b7f-c952-4d43-96b9-d688acd21e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:27 devstack sudo[94895]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7eb075-5b9d-4b5b-ad33-fd25dfcdfc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5" returned: 0 in 1.063s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] <== create_volume: return (2328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.332s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7eb075-5b9d-4b5b-ad33-fd25dfcdfc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2070397443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e04e0a0-13d4-48d0-a8cd-d6f666cd3a60,host='devstack@QuobyteHD#QuobyteHD',id=8c4605cf-5693-4763-914c-fddb7c48a43d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869945f21bad402fa334beba41eec722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:28Z,use_quota=True,user_id='2879b4c844094ee4bf2f90016538a11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5cf3520-d0ed-45d1-b24f-24fc13842b5d),volume_type_id=d5cf3520-d0ed-45d1-b24f-24fc13842b5d)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b7f97c1-43a4-4d5b-b131-bc6c748c28b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b7f97c1-43a4-4d5b-b131-bc6c748c28b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4243c7-99f5-4a3f-b146-da778329e8a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d4243c7-99f5-4a3f-b146-da778329e8a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c4605cf-5693-4763-914c-fddb7c48a43d', 'volume_name': 'volume-8c4605cf-5693-4763-914c-fddb7c48a43d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd77d80-90dd-4b9d-b5ca-55bff3d5e768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fd77d80-90dd-4b9d-b5ca-55bff3d5e768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aec04a0-bb41-4139-b32a-1338ec0302d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:27 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Volume 8c4605cf-5693-4763-914c-fddb7c48a43d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c4605cf-5693-4763-914c-fddb7c48a43d', 'volume_size': 1} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6e04e0a0-13d4-48d0-a8cd-d6f666cd3a60,created_at=2026-07-08T12:34:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2070397443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e04e0a0-13d4-48d0-a8cd-d6f666cd3a60,host='devstack@QuobyteHD#QuobyteHD',id=8c4605cf-5693-4763-914c-fddb7c48a43d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869945f21bad402fa334beba41eec722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:28Z,use_quota=True,user_id='2879b4c844094ee4bf2f90016538a11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5cf3520-d0ed-45d1-b24f-24fc13842b5d),volume_type_id=d5cf3520-d0ed-45d1-b24f-24fc13842b5d)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Creating volume 8c4605cf-5693-4763-914c-fddb7c48a43d {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:34:27 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df50e0da-b05e-44f8-b07e-917f332ac41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-422deb14-5724-44e2-826b-64ff257828f5', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14f7ad4-3abb-42eb-9f09-75ea438648e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:27 devstack sudo[94898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d 1073741824 Jul 08 14:34:27 devstack sudo[94898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:27 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Volume volume-422deb14-5724-44e2-826b-64ff257828f5 (422deb14-5724-44e2-826b-64ff257828f5): created successfully Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14f7ad4-3abb-42eb-9f09-75ea438648e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Flow 'volume_create_manager' (e87bc452-beb5-48db-acb1-920aeed29d9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:27 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c3efcbee-6069-41c8-b10b-1944d11e8f8c tempest-CreateVolumesFromSnapshotTest-730689828 None] Created volume successfully. Jul 08 14:34:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-60ab3c41-d86e-47d0-8383-62b33d1d19ba tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:29 devstack sudo[94898]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d 1073741824" returned: 0 in 1.324s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:29 devstack sudo[94907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d Jul 08 14:34:29 devstack sudo[94907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:30 devstack sudo[94907]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d" returned: 0 in 0.979s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] <== create_volume: return (2386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:34:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.389s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-60ab3c41-d86e-47d0-8383-62b33d1d19ba tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.680s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-60ab3c41-d86e-47d0-8383-62b33d1d19ba tempest-CreateVolumesFromSnapshotTest-730689828 None] Creating offline snapshot eadafc07-4121-41fe-a8bf-bf12ba59f845 of volume 422deb14-5724-44e2-826b-64ff257828f5 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aec04a0-bb41-4139-b32a-1338ec0302d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c4605cf-5693-4763-914c-fddb7c48a43d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd946ed5-4404-409c-833f-6d8876145ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:30 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[41340ac2-ddc8-431c-858b-588901c8a588]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:34:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-60ab3c41-d86e-47d0-8383-62b33d1d19ba tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:30 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Volume volume-8c4605cf-5693-4763-914c-fddb7c48a43d (8c4605cf-5693-4763-914c-fddb7c48a43d): created successfully Jul 08 14:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd946ed5-4404-409c-833f-6d8876145ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Flow 'volume_create_manager' (9a069b7f-c952-4d43-96b9-d688acd21e8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:30 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-dea51dd3-784a-4538-9e76-140287821dde tempest-GroupSnapshotsTest-449637402 None] Created volume successfully. Jul 08 14:34:30 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5 Jul 08 14:34:30 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:31 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-60ab3c41-d86e-47d0-8383-62b33d1d19ba tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5" returned: 0 in 1.235s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-60ab3c41-d86e-47d0-8383-62b33d1d19ba tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.eadafc07-4121-41fe-a8bf-bf12ba59f845 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:31 devstack sudo[94935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.eadafc07-4121-41fe-a8bf-bf12ba59f845 1G Jul 08 14:34:31 devstack sudo[94935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Flow 'volume_create_manager' (fecf7ce3-4dd6-4358-9e43-bfb9e3b8bb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860c8fbb-04dd-4dba-94f5-d6f9dff629a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860c8fbb-04dd-4dba-94f5-d6f9dff629a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-214041848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e04e0a0-13d4-48d0-a8cd-d6f666cd3a60,host='devstack@QuobyteHD#QuobyteHD',id=ab4a3250-44d3-4fa2-9148-ff1557e883d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869945f21bad402fa334beba41eec722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:32Z,use_quota=True,user_id='2879b4c844094ee4bf2f90016538a11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5cf3520-d0ed-45d1-b24f-24fc13842b5d),volume_type_id=d5cf3520-d0ed-45d1-b24f-24fc13842b5d)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31919715-4d82-44cf-86d7-8f338813626c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31919715-4d82-44cf-86d7-8f338813626c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0e09c5-02ca-44d4-8b96-b6d4967ba6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0e09c5-02ca-44d4-8b96-b6d4967ba6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab4a3250-44d3-4fa2-9148-ff1557e883d2', 'volume_name': 'volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1414aa5-b221-4de2-9f6b-f0528bf2ef3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1414aa5-b221-4de2-9f6b-f0528bf2ef3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ddf49e6-3c29-4d95-9f6c-0e7cb4b83cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:32 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Volume ab4a3250-44d3-4fa2-9148-ff1557e883d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2', 'volume_size': 1} Jul 08 14:34:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:32 devstack sudo[94935]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-60ab3c41-d86e-47d0-8383-62b33d1d19ba tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.eadafc07-4121-41fe-a8bf-bf12ba59f845 1G" returned: 0 in 1.207s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-60ab3c41-d86e-47d0-8383-62b33d1d19ba tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-422deb14-5724-44e2-826b-64ff257828f5 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.eadafc07-4121-41fe-a8bf-bf12ba59f845 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:32 devstack sudo[94941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-422deb14-5724-44e2-826b-64ff257828f5 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.eadafc07-4121-41fe-a8bf-bf12ba59f845 Jul 08 14:34:32 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:33 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-60ab3c41-d86e-47d0-8383-62b33d1d19ba tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-422deb14-5724-44e2-826b-64ff257828f5 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.eadafc07-4121-41fe-a8bf-bf12ba59f845" returned: 0 in 0.893s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:33 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-60ab3c41-d86e-47d0-8383-62b33d1d19ba tempest-CreateVolumesFromSnapshotTest-730689828 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.eadafc07-4121-41fe-a8bf-bf12ba59f845 is being set with open permissions: ugo+rw Jul 08 14:34:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-60ab3c41-d86e-47d0-8383-62b33d1d19ba tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.eadafc07-4121-41fe-a8bf-bf12ba59f845 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:33 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.eadafc07-4121-41fe-a8bf-bf12ba59f845 Jul 08 14:34:33 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:34 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-60ab3c41-d86e-47d0-8383-62b33d1d19ba tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.eadafc07-4121-41fe-a8bf-bf12ba59f845" returned: 0 in 0.942s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-60ab3c41-d86e-47d0-8383-62b33d1d19ba tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:34 devstack sudo[94975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.info Jul 08 14:34:34 devstack sudo[94975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:35 devstack sudo[94975]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-60ab3c41-d86e-47d0-8383-62b33d1d19ba tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.info" returned: 0 in 1.194s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:35 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-60ab3c41-d86e-47d0-8383-62b33d1d19ba tempest-CreateVolumesFromSnapshotTest-730689828 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.info is being set with open permissions: ugo+rw Jul 08 14:34:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-60ab3c41-d86e-47d0-8383-62b33d1d19ba tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:35 devstack sudo[95000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.info Jul 08 14:34:35 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:36 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-60ab3c41-d86e-47d0-8383-62b33d1d19ba tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.info" returned: 0 in 0.930s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-60ab3c41-d86e-47d0-8383-62b33d1d19ba tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.557s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.231s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6e04e0a0-13d4-48d0-a8cd-d6f666cd3a60,created_at=2026-07-08T12:34:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-214041848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6e04e0a0-13d4-48d0-a8cd-d6f666cd3a60,host='devstack@QuobyteHD#QuobyteHD',id=ab4a3250-44d3-4fa2-9148-ff1557e883d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869945f21bad402fa334beba41eec722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:32Z,use_quota=True,user_id='2879b4c844094ee4bf2f90016538a11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5cf3520-d0ed-45d1-b24f-24fc13842b5d),volume_type_id=d5cf3520-d0ed-45d1-b24f-24fc13842b5d)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:34:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Creating volume ab4a3250-44d3-4fa2-9148-ff1557e883d2 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:34:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:34:36 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:34:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:36 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2 1073741824 Jul 08 14:34:36 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:36 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-60ab3c41-d86e-47d0-8383-62b33d1d19ba tempest-CreateVolumesFromSnapshotTest-730689828 None] Create snapshot completed successfully Jul 08 14:34:38 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:34:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Flow 'volume_create_manager' (3efb7e99-d19b-4675-a66a-87e8685e858f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190242ec-76ce-4012-bfe7-06a2676c9d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (190242ec-76ce-4012-bfe7-06a2676c9d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-120526194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f418a4-e277-44ef-807e-bd4e8938fcbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd52fafe65e24c0aa5cfd8097a87c1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:38Z,use_quota=True,user_id='685f0a4425874c5dbd86a927cd75cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5284a3e-fc45-40d3-9c2b-f47b5c4db705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5284a3e-fc45-40d3-9c2b-f47b5c4db705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09030517-2d01-448f-94a1-e031df01a731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09030517-2d01-448f-94a1-e031df01a731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46f418a4-e277-44ef-807e-bd4e8938fcbf', 'volume_name': 'volume-46f418a4-e277-44ef-807e-bd4e8938fcbf', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0075d83b-df22-48d7-a51d-c75b609fed52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0075d83b-df22-48d7-a51d-c75b609fed52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db60b7cb-fb77-485a-8872-c12874351153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:38 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Volume 46f418a4-e277-44ef-807e-bd4e8938fcbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46f418a4-e277-44ef-807e-bd4e8938fcbf', 'volume_size': 1} Jul 08 14:34:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:38 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2 1073741824" returned: 0 in 1.723s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:38 devstack sudo[95049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2 Jul 08 14:34:38 devstack sudo[95049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:39 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:34:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Flow 'volume_create_manager' (24df16bd-3e66-4d51-862f-67be821053be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb52db4-b8c0-4d47-9c3d-f3e4f023ccef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffb52db4-b8c0-4d47-9c3d-f3e4f023ccef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-213726005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adaa01da-6303-4cf7-b15c-a0ea222313fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd52fafe65e24c0aa5cfd8097a87c1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:39Z,use_quota=True,user_id='685f0a4425874c5dbd86a927cd75cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa65ad6d-10d2-4fc7-89c2-f1d4a61aa78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa65ad6d-10d2-4fc7-89c2-f1d4a61aa78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024b26b9-1a9f-4361-8f60-3c34df0c1c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (024b26b9-1a9f-4361-8f60-3c34df0c1c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adaa01da-6303-4cf7-b15c-a0ea222313fa', 'volume_name': 'volume-adaa01da-6303-4cf7-b15c-a0ea222313fa', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b169f217-3aa6-4d11-be42-e62af68bc4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b169f217-3aa6-4d11-be42-e62af68bc4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe2a854-8a04-49d8-924b-8c8ec7059d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:39 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Volume adaa01da-6303-4cf7-b15c-a0ea222313fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adaa01da-6303-4cf7-b15c-a0ea222313fa', 'volume_size': 1} Jul 08 14:34:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Flow 'volume_create_manager' (8797988d-60e4-4b18-8914-37b16795120a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7961b3b6-6254-4ba0-9cf1-626ff76c5ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7961b3b6-6254-4ba0-9cf1-626ff76c5ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1026529186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ebc10b-7755-43e2-a411-702b8dabb4f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd52fafe65e24c0aa5cfd8097a87c1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:40Z,use_quota=True,user_id='685f0a4425874c5dbd86a927cd75cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (effafb2a-5eea-4ce1-ab6e-189f1a420e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (effafb2a-5eea-4ce1-ab6e-189f1a420e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee3d38b-3529-48b4-b96d-74b8857bd13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee3d38b-3529-48b4-b96d-74b8857bd13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88ebc10b-7755-43e2-a411-702b8dabb4f7', 'volume_name': 'volume-88ebc10b-7755-43e2-a411-702b8dabb4f7', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97611581-3d37-416e-81a4-7aaba7384ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97611581-3d37-416e-81a4-7aaba7384ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:40 devstack sudo[95049]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687df861-6a3e-45ac-b1eb-7f00c54834b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:40 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Volume 88ebc10b-7755-43e2-a411-702b8dabb4f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88ebc10b-7755-43e2-a411-702b8dabb4f7', 'volume_size': 1} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2" returned: 0 in 1.760s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] <== create_volume: return (3594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.600s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.181s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-120526194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46f418a4-e277-44ef-807e-bd4e8938fcbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd52fafe65e24c0aa5cfd8097a87c1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:38Z,use_quota=True,user_id='685f0a4425874c5dbd86a927cd75cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Creating volume 46f418a4-e277-44ef-807e-bd4e8938fcbf {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:34:40 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-46f418a4-e277-44ef-807e-bd4e8938fcbf 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:40 devstack sudo[95088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-46f418a4-e277-44ef-807e-bd4e8938fcbf 1073741824 Jul 08 14:34:40 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ddf49e6-3c29-4d95-9f6c-0e7cb4b83cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d7c6d69-9d7b-4d31-9f09-02679bf98424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:40 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Volume volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2 (ab4a3250-44d3-4fa2-9148-ff1557e883d2): created successfully Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d7c6d69-9d7b-4d31-9f09-02679bf98424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Flow 'volume_create_manager' (fecf7ce3-4dd6-4358-9e43-bfb9e3b8bb36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:40 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-acaa3b9a-2312-400a-a462-362118e28810 tempest-GroupSnapshotsTest-449637402 None] Created volume successfully. Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Flow 'volume_create_manager' (10895a79-3efe-4aea-9827-bc35a008860c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac658907-8ed1-42c4-b239-a31af1186c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac658907-8ed1-42c4-b239-a31af1186c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1455510784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f59b2d27-0e2e-46e0-8685-ee91bf253fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd52fafe65e24c0aa5cfd8097a87c1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:41Z,use_quota=True,user_id='685f0a4425874c5dbd86a927cd75cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce2aa45-524a-461f-ad93-73efbf3f3119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce2aa45-524a-461f-ad93-73efbf3f3119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900236d3-4df2-4539-9689-4d39b28a938b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (900236d3-4df2-4539-9689-4d39b28a938b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f59b2d27-0e2e-46e0-8685-ee91bf253fb7', 'volume_name': 'volume-f59b2d27-0e2e-46e0-8685-ee91bf253fb7', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69ec86a-3ecc-40f7-a674-639366732afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69ec86a-3ecc-40f7-a674-639366732afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b279a08-7389-4f2d-ae38-e27cfa4537a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:41 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Volume f59b2d27-0e2e-46e0-8685-ee91bf253fb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f59b2d27-0e2e-46e0-8685-ee91bf253fb7', 'volume_size': 1} Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Flow 'volume_create_manager' (f9a19320-1060-4fae-896e-b0fe517f0e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b7fa00-8d12-44a6-9e02-ce8f8a5dc4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37b7fa00-8d12-44a6-9e02-ce8f8a5dc4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-659496437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=444ee159-864a-4786-bf3a-494278c66c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd52fafe65e24c0aa5cfd8097a87c1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:42Z,use_quota=True,user_id='685f0a4425874c5dbd86a927cd75cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58148270-0126-4312-ac40-f746de8d6f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58148270-0126-4312-ac40-f746de8d6f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72456d50-c1d4-4c91-8cd0-af8f5b2c2485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72456d50-c1d4-4c91-8cd0-af8f5b2c2485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '444ee159-864a-4786-bf3a-494278c66c55', 'volume_name': 'volume-444ee159-864a-4786-bf3a-494278c66c55', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86fa35a-4d3d-4ef0-8c85-4298ba7b0779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d86fa35a-4d3d-4ef0-8c85-4298ba7b0779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc157f91-343b-471c-8a86-c55a503494c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:41 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Volume 444ee159-864a-4786-bf3a-494278c66c55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-444ee159-864a-4786-bf3a-494278c66c55', 'volume_size': 1} Jul 08 14:34:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c98959e7-a0a3-414b-bca4-e0fee8397ebc tempest-GroupSnapshotsTest-449637402 None] Update group completed successfully. Jul 08 14:34:42 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-46f418a4-e277-44ef-807e-bd4e8938fcbf 1073741824" returned: 0 in 1.940s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-46f418a4-e277-44ef-807e-bd4e8938fcbf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:42 devstack sudo[95095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-46f418a4-e277-44ef-807e-bd4e8938fcbf Jul 08 14:34:42 devstack sudo[95095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:43 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8792ecb7-b8dd-47c9-a452-6ae677814feb tempest-GroupSnapshotsTest-449637402 None] Update group completed successfully. Jul 08 14:34:43 devstack sudo[95095]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-46f418a4-e277-44ef-807e-bd4e8938fcbf" returned: 0 in 1.489s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] <== create_volume: return (3508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.514s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.572s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-213726005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adaa01da-6303-4cf7-b15c-a0ea222313fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd52fafe65e24c0aa5cfd8097a87c1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:39Z,use_quota=True,user_id='685f0a4425874c5dbd86a927cd75cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:34:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Creating volume adaa01da-6303-4cf7-b15c-a0ea222313fa {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:34:43 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:34:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-adaa01da-6303-4cf7-b15c-a0ea222313fa 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db60b7cb-fb77-485a-8872-c12874351153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46f418a4-e277-44ef-807e-bd4e8938fcbf', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155e6407-e75a-464d-b16f-b476aea6e8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:44 devstack sudo[95136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-adaa01da-6303-4cf7-b15c-a0ea222313fa 1073741824 Jul 08 14:34:44 devstack sudo[95136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:44 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Volume volume-46f418a4-e277-44ef-807e-bd4e8938fcbf (46f418a4-e277-44ef-807e-bd4e8938fcbf): created successfully Jul 08 14:34:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155e6407-e75a-464d-b16f-b476aea6e8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Flow 'volume_create_manager' (3efb7e99-d19b-4675-a66a-87e8685e858f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-45943b7f-c596-4586-b741-ee4df5528ff4 tempest-CreateVolumesFromSnapshotTest-730689828 None] Created volume successfully. Jul 08 14:34:45 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-70e0db7b-d3a4-4481-b972-e469a8ab411c tempest-GroupSnapshotsTest-449637402 None] Update group completed successfully. Jul 08 14:34:46 devstack sudo[95136]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-adaa01da-6303-4cf7-b15c-a0ea222313fa 1073741824" returned: 0 in 2.045s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-adaa01da-6303-4cf7-b15c-a0ea222313fa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:46 devstack sudo[95174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-adaa01da-6303-4cf7-b15c-a0ea222313fa Jul 08 14:34:46 devstack sudo[95174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-33012d85-9d6f-4a89-83fc-8e25576b6880 tempest-GroupSnapshotsTest-449637402 None] Update group completed successfully. Jul 08 14:34:47 devstack sudo[95174]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-adaa01da-6303-4cf7-b15c-a0ea222313fa" returned: 0 in 1.530s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] <== create_volume: return (3678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:34:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.684s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.227s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1026529186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88ebc10b-7755-43e2-a411-702b8dabb4f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd52fafe65e24c0aa5cfd8097a87c1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:40Z,use_quota=True,user_id='685f0a4425874c5dbd86a927cd75cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:34:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Creating volume 88ebc10b-7755-43e2-a411-702b8dabb4f7 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:34:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:34:47 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:34:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-88ebc10b-7755-43e2-a411-702b8dabb4f7 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe2a854-8a04-49d8-924b-8c8ec7059d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adaa01da-6303-4cf7-b15c-a0ea222313fa', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a405f5-8881-4d45-8f96-b403fdb64eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:47 devstack sudo[95180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-88ebc10b-7755-43e2-a411-702b8dabb4f7 1073741824 Jul 08 14:34:47 devstack sudo[95180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:47 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Volume volume-adaa01da-6303-4cf7-b15c-a0ea222313fa (adaa01da-6303-4cf7-b15c-a0ea222313fa): created successfully Jul 08 14:34:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a405f5-8881-4d45-8f96-b403fdb64eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Flow 'volume_create_manager' (24df16bd-3e66-4d51-862f-67be821053be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fd782561-c515-4619-b0c8-ea9dffd2b44c tempest-CreateVolumesFromSnapshotTest-730689828 None] Created volume successfully. Jul 08 14:34:49 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] GroupSnapshot efeaad87-a174-4198-a494-782bc9e31852: creating. Jul 08 14:34:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] Group snapshot efeaad87-a174-4198-a494-782bc9e31852: creating. {{(pid=87240) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 14:34:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:50 devstack sudo[95180]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-88ebc10b-7755-43e2-a411-702b8dabb4f7 1073741824" returned: 0 in 2.456s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-88ebc10b-7755-43e2-a411-702b8dabb4f7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:50 devstack sudo[95201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-88ebc10b-7755-43e2-a411-702b8dabb4f7 Jul 08 14:34:50 devstack sudo[95201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:50 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:34:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Flow 'volume_create_manager' (3ee1b5e7-6634-47b4-8e02-760fee44eabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca44134-4362-4142-a845-78ea533ffd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ca44134-4362-4142-a845-78ea533ffd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-372601728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80bcb236-9e31-4f4f-8a07-3838b2dc3162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d062e082db7742238b6f385a58219200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:50Z,use_quota=True,user_id='2696c54e57e34664b020376dc42b27e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e80cc7-e714-450a-9d68-c0c3e102c9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29e80cc7-e714-450a-9d68-c0c3e102c9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505307c1-9ec5-495f-8d9f-56762a95e520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505307c1-9ec5-495f-8d9f-56762a95e520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80bcb236-9e31-4f4f-8a07-3838b2dc3162', 'volume_name': 'volume-80bcb236-9e31-4f4f-8a07-3838b2dc3162', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d687c56-3080-49ce-8526-be9272a08ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d687c56-3080-49ce-8526-be9272a08ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ecb7543-c503-4ca7-9674-62f8aa08092b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:50 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Volume 80bcb236-9e31-4f4f-8a07-3838b2dc3162: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80bcb236-9e31-4f4f-8a07-3838b2dc3162', 'volume_size': 1} Jul 08 14:34:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:51 devstack sudo[95201]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-88ebc10b-7755-43e2-a411-702b8dabb4f7" returned: 0 in 1.141s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] <== create_volume: return (3699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:34:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.703s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.048s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1455510784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f59b2d27-0e2e-46e0-8685-ee91bf253fb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd52fafe65e24c0aa5cfd8097a87c1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:41Z,use_quota=True,user_id='685f0a4425874c5dbd86a927cd75cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:34:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Creating volume f59b2d27-0e2e-46e0-8685-ee91bf253fb7 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:34:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:34:51 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:34:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f59b2d27-0e2e-46e0-8685-ee91bf253fb7 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687df861-6a3e-45ac-b1eb-7f00c54834b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88ebc10b-7755-43e2-a411-702b8dabb4f7', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:51 devstack sudo[95218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f59b2d27-0e2e-46e0-8685-ee91bf253fb7 1073741824 Jul 08 14:34:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (398f22cf-f936-4480-9d39-2b928f3804e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:51 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:51 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Volume volume-88ebc10b-7755-43e2-a411-702b8dabb4f7 (88ebc10b-7755-43e2-a411-702b8dabb4f7): created successfully Jul 08 14:34:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (398f22cf-f936-4480-9d39-2b928f3804e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Flow 'volume_create_manager' (8797988d-60e4-4b18-8914-37b16795120a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:51 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ea20535d-7288-4b79-997f-b01a56eaa33f tempest-CreateVolumesFromSnapshotTest-730689828 None] Created volume successfully. Jul 08 14:34:52 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f59b2d27-0e2e-46e0-8685-ee91bf253fb7 1073741824" returned: 0 in 1.195s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f59b2d27-0e2e-46e0-8685-ee91bf253fb7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:52 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f59b2d27-0e2e-46e0-8685-ee91bf253fb7 Jul 08 14:34:52 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:53 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f59b2d27-0e2e-46e0-8685-ee91bf253fb7" returned: 0 in 0.806s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] <== create_volume: return (2064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:34:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.073s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.473s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-659496437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=444ee159-864a-4786-bf3a-494278c66c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd52fafe65e24c0aa5cfd8097a87c1ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:42Z,use_quota=True,user_id='685f0a4425874c5dbd86a927cd75cde7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:34:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Creating volume 444ee159-864a-4786-bf3a-494278c66c55 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:34:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:34:53 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:34:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-444ee159-864a-4786-bf3a-494278c66c55 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:53 devstack sudo[95270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-444ee159-864a-4786-bf3a-494278c66c55 1073741824 Jul 08 14:34:53 devstack sudo[95270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b279a08-7389-4f2d-ae38-e27cfa4537a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f59b2d27-0e2e-46e0-8685-ee91bf253fb7', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24b6e7c-4957-47cc-8fe2-1dc0084730be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:53 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Volume volume-f59b2d27-0e2e-46e0-8685-ee91bf253fb7 (f59b2d27-0e2e-46e0-8685-ee91bf253fb7): created successfully Jul 08 14:34:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a24b6e7c-4957-47cc-8fe2-1dc0084730be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Flow 'volume_create_manager' (10895a79-3efe-4aea-9827-bc35a008860c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:53 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-89059183-b98f-44a2-9d06-a4c341345eb3 tempest-CreateVolumesFromSnapshotTest-730689828 None] Created volume successfully. Jul 08 14:34:54 devstack sudo[95270]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-444ee159-864a-4786-bf3a-494278c66c55 1073741824" returned: 0 in 1.016s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-444ee159-864a-4786-bf3a-494278c66c55 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:54 devstack sudo[95276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-444ee159-864a-4786-bf3a-494278c66c55 Jul 08 14:34:54 devstack sudo[95276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:55 devstack sudo[95276]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-444ee159-864a-4786-bf3a-494278c66c55" returned: 0 in 0.812s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:34:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.074s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc157f91-343b-471c-8a86-c55a503494c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-444ee159-864a-4786-bf3a-494278c66c55', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953b72dd-c2e5-430f-b8dc-2e11762472ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] Creating offline snapshot 0eb5da36-82bd-4cf4-8150-d2742cb4b92b of volume ab4a3250-44d3-4fa2-9148-ff1557e883d2 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:34:55 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda434e7-3bce-4868-8924-1aac8113467c]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:34:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:55 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Volume volume-444ee159-864a-4786-bf3a-494278c66c55 (444ee159-864a-4786-bf3a-494278c66c55): created successfully Jul 08 14:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (953b72dd-c2e5-430f-b8dc-2e11762472ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:34:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Flow 'volume_create_manager' (f9a19320-1060-4fae-896e-b0fe517f0e0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:34:55 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9c5fc8b9-79ca-4230-b42f-ac883987e15e tempest-CreateVolumesFromSnapshotTest-730689828 None] Created volume successfully. Jul 08 14:34:55 devstack sudo[95279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2 Jul 08 14:34:55 devstack sudo[95279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e74d9480-126b-404b-9f84-fb3dd450f8b0 tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "cinder-444ee159-864a-4786-bf3a-494278c66c55-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:34:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e74d9480-126b-404b-9f84-fb3dd450f8b0 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-444ee159-864a-4786-bf3a-494278c66c55-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:34:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e74d9480-126b-404b-9f84-fb3dd450f8b0 tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "cinder-quobyte-444ee159-864a-4786-bf3a-494278c66c55" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:34:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e74d9480-126b-404b-9f84-fb3dd450f8b0 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-quobyte-444ee159-864a-4786-bf3a-494278c66c55" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:34:56 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b637feaa-782d-49d4-9e38-99445c258e03]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:34:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e74d9480-126b-404b-9f84-fb3dd450f8b0 tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-444ee159-864a-4786-bf3a-494278c66c55 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:56 devstack sudo[95281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-444ee159-864a-4786-bf3a-494278c66c55 Jul 08 14:34:56 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:56 devstack sudo[95279]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2" returned: 0 in 0.961s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.0eb5da36-82bd-4cf4-8150-d2742cb4b92b 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:56 devstack sudo[95287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.0eb5da36-82bd-4cf4-8150-d2742cb4b92b 1G Jul 08 14:34:56 devstack sudo[95287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:56 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e74d9480-126b-404b-9f84-fb3dd450f8b0 tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-444ee159-864a-4786-bf3a-494278c66c55" returned: 0 in 0.823s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e74d9480-126b-404b-9f84-fb3dd450f8b0 tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-444ee159-864a-4786-bf3a-494278c66c55 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:56 devstack sudo[95293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-444ee159-864a-4786-bf3a-494278c66c55 Jul 08 14:34:56 devstack sudo[95293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:57 devstack sudo[95287]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.0eb5da36-82bd-4cf4-8150-d2742cb4b92b 1G" returned: 0 in 0.981s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.0eb5da36-82bd-4cf4-8150-d2742cb4b92b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:57 devstack sudo[95299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.0eb5da36-82bd-4cf4-8150-d2742cb4b92b Jul 08 14:34:57 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:57 devstack sudo[95293]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e74d9480-126b-404b-9f84-fb3dd450f8b0 tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-444ee159-864a-4786-bf3a-494278c66c55" returned: 0 in 0.759s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e74d9480-126b-404b-9f84-fb3dd450f8b0 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-quobyte-444ee159-864a-4786-bf3a-494278c66c55" released by "delete_volume" :: held 1.629s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:57 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-e74d9480-126b-404b-9f84-fb3dd450f8b0 tempest-CreateVolumesFromSnapshotTest-730689828 None] Created reservations ['14da8563-3966-4b04-8a2d-83eab7be3a0f', '6b37774f-b876-498d-ad2a-0a7f6e6e82ac', '375e84c1-6cce-405b-a73b-c0ef1c19d998', '5a63098d-3c92-4f84-a66b-41305d29f74d'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:34:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e74d9480-126b-404b-9f84-fb3dd450f8b0 tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e74d9480-126b-404b-9f84-fb3dd450f8b0 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e74d9480-126b-404b-9f84-fb3dd450f8b0 tempest-CreateVolumesFromSnapshotTest-730689828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e74d9480-126b-404b-9f84-fb3dd450f8b0 tempest-CreateVolumesFromSnapshotTest-730689828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e74d9480-126b-404b-9f84-fb3dd450f8b0 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e74d9480-126b-404b-9f84-fb3dd450f8b0 tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:57 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:34:57 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-96e0c426-049a-415b-af28-285b04c9c424 tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "cinder-f59b2d27-0e2e-46e0-8685-ee91bf253fb7-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:34:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-96e0c426-049a-415b-af28-285b04c9c424 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-f59b2d27-0e2e-46e0-8685-ee91bf253fb7-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:34:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-96e0c426-049a-415b-af28-285b04c9c424 tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "cinder-quobyte-f59b2d27-0e2e-46e0-8685-ee91bf253fb7" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:34:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-96e0c426-049a-415b-af28-285b04c9c424 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-quobyte-f59b2d27-0e2e-46e0-8685-ee91bf253fb7" acquired by "delete_volume" :: waited 0.043s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:34:58 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.0eb5da36-82bd-4cf4-8150-d2742cb4b92b" returned: 0 in 1.065s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:58 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.0eb5da36-82bd-4cf4-8150-d2742cb4b92b is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:34:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.0eb5da36-82bd-4cf4-8150-d2742cb4b92b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:58 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6af29a-547e-4908-b8e8-81ded4d041f2]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:34:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-96e0c426-049a-415b-af28-285b04c9c424 tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f59b2d27-0e2e-46e0-8685-ee91bf253fb7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:58 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.0eb5da36-82bd-4cf4-8150-d2742cb4b92b Jul 08 14:34:58 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:58 devstack sudo[95308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f59b2d27-0e2e-46e0-8685-ee91bf253fb7 Jul 08 14:34:58 devstack sudo[95308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:58 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e74d9480-126b-404b-9f84-fb3dd450f8b0 tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.919s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:58 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-e74d9480-126b-404b-9f84-fb3dd450f8b0 tempest-CreateVolumesFromSnapshotTest-730689828 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:34:58 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e74d9480-126b-404b-9f84-fb3dd450f8b0 tempest-CreateVolumesFromSnapshotTest-730689828 None] Deleted volume successfully. Jul 08 14:34:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e74d9480-126b-404b-9f84-fb3dd450f8b0 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-444ee159-864a-4786-bf3a-494278c66c55-delete_volume" released by "delete_volume" :: held 2.865s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:34:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:34:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:34:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:34:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:34:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:34:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:34:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:59 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.0eb5da36-82bd-4cf4-8150-d2742cb4b92b" returned: 0 in 0.865s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:59 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:34:59 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:59 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.info Jul 08 14:34:59 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:34:59 devstack sudo[95308]: pam_unix(sudo:session): session closed for user root Jul 08 14:34:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-96e0c426-049a-415b-af28-285b04c9c424 tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f59b2d27-0e2e-46e0-8685-ee91bf253fb7" returned: 0 in 1.058s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:34:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-96e0c426-049a-415b-af28-285b04c9c424 tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f59b2d27-0e2e-46e0-8685-ee91bf253fb7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:34:59 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f59b2d27-0e2e-46e0-8685-ee91bf253fb7 Jul 08 14:34:59 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:00 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.935s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:35:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 8 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:35:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:35:00 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-96e0c426-049a-415b-af28-285b04c9c424 tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f59b2d27-0e2e-46e0-8685-ee91bf253fb7" returned: 0 in 0.907s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-96e0c426-049a-415b-af28-285b04c9c424 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-quobyte-f59b2d27-0e2e-46e0-8685-ee91bf253fb7" released by "delete_volume" :: held 2.039s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:00 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.info" returned: 0 in 1.166s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:00 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:35:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:00 devstack sudo[95325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.info Jul 08 14:35:00 devstack sudo[95325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:00 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-96e0c426-049a-415b-af28-285b04c9c424 tempest-CreateVolumesFromSnapshotTest-730689828 None] Created reservations ['4f9bfda3-0fe5-4258-aa42-abc4d5fa0fc1', '99cb55af-e09e-4b92-95c2-ade94353d14b', '9090d45a-7ed4-4513-b7dc-d08879f19817', '6e3c4058-e6d2-4519-9a8f-393511357517'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-96e0c426-049a-415b-af28-285b04c9c424 tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-96e0c426-049a-415b-af28-285b04c9c424 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-96e0c426-049a-415b-af28-285b04c9c424 tempest-CreateVolumesFromSnapshotTest-730689828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-96e0c426-049a-415b-af28-285b04c9c424 tempest-CreateVolumesFromSnapshotTest-730689828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-96e0c426-049a-415b-af28-285b04c9c424 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-96e0c426-049a-415b-af28-285b04c9c424 tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:00 devstack sudo[95327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:35:00 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:01 devstack sudo[95325]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.info" returned: 0 in 1.042s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.252s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] Creating offline snapshot 86e09cb7-b433-4306-a784-24b445409fb6 of volume 8c4605cf-5693-4763-914c-fddb7c48a43d {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:35:01 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d192c45d-f05a-4570-a740-025205454b75]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2b3dcbee-579f-4a6d-8525-64a1e5538b37 tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "cinder-88ebc10b-7755-43e2-a411-702b8dabb4f7-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2b3dcbee-579f-4a6d-8525-64a1e5538b37 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-88ebc10b-7755-43e2-a411-702b8dabb4f7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:01 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:01 devstack sudo[95363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d Jul 08 14:35:01 devstack sudo[95363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-96e0c426-049a-415b-af28-285b04c9c424 tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.108s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:01 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-96e0c426-049a-415b-af28-285b04c9c424 tempest-CreateVolumesFromSnapshotTest-730689828 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:01 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-96e0c426-049a-415b-af28-285b04c9c424 tempest-CreateVolumesFromSnapshotTest-730689828 None] Deleted volume successfully. Jul 08 14:35:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2b3dcbee-579f-4a6d-8525-64a1e5538b37 tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "cinder-quobyte-88ebc10b-7755-43e2-a411-702b8dabb4f7" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2b3dcbee-579f-4a6d-8525-64a1e5538b37 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-quobyte-88ebc10b-7755-43e2-a411-702b8dabb4f7" acquired by "delete_volume" :: waited 0.042s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-96e0c426-049a-415b-af28-285b04c9c424 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-f59b2d27-0e2e-46e0-8685-ee91bf253fb7-delete_volume" released by "delete_volume" :: held 3.664s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:01 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b758f8-728a-45ba-b9aa-b604124a6449]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2b3dcbee-579f-4a6d-8525-64a1e5538b37 tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-88ebc10b-7755-43e2-a411-702b8dabb4f7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:02 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-88ebc10b-7755-43e2-a411-702b8dabb4f7 Jul 08 14:35:02 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:02 devstack sudo[95363]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d" returned: 0 in 0.974s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.86e09cb7-b433-4306-a784-24b445409fb6 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:02 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.86e09cb7-b433-4306-a784-24b445409fb6 1G Jul 08 14:35:02 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:02 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2b3dcbee-579f-4a6d-8525-64a1e5538b37 tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-88ebc10b-7755-43e2-a411-702b8dabb4f7" returned: 0 in 0.889s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2b3dcbee-579f-4a6d-8525-64a1e5538b37 tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-88ebc10b-7755-43e2-a411-702b8dabb4f7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:02 devstack sudo[95379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-88ebc10b-7755-43e2-a411-702b8dabb4f7 Jul 08 14:35:02 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:03 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.86e09cb7-b433-4306-a784-24b445409fb6 1G" returned: 0 in 0.932s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c4605cf-5693-4763-914c-fddb7c48a43d -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.86e09cb7-b433-4306-a784-24b445409fb6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:03 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c4605cf-5693-4763-914c-fddb7c48a43d -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.86e09cb7-b433-4306-a784-24b445409fb6 Jul 08 14:35:03 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:03 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2b3dcbee-579f-4a6d-8525-64a1e5538b37 tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-88ebc10b-7755-43e2-a411-702b8dabb4f7" returned: 0 in 0.765s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2b3dcbee-579f-4a6d-8525-64a1e5538b37 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-quobyte-88ebc10b-7755-43e2-a411-702b8dabb4f7" released by "delete_volume" :: held 1.708s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:03 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-2b3dcbee-579f-4a6d-8525-64a1e5538b37 tempest-CreateVolumesFromSnapshotTest-730689828 None] Created reservations ['3b723ad4-a770-4f9e-aa08-d597f96b6b6b', 'c62b7198-1ed1-475e-8446-c086439f983e', 'cc865ec4-f89c-4233-944d-f7fd8e942175', '042da38a-852c-4beb-87f7-7578a34db88c'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2b3dcbee-579f-4a6d-8525-64a1e5538b37 tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2b3dcbee-579f-4a6d-8525-64a1e5538b37 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2b3dcbee-579f-4a6d-8525-64a1e5538b37 tempest-CreateVolumesFromSnapshotTest-730689828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2b3dcbee-579f-4a6d-8525-64a1e5538b37 tempest-CreateVolumesFromSnapshotTest-730689828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2b3dcbee-579f-4a6d-8525-64a1e5538b37 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2b3dcbee-579f-4a6d-8525-64a1e5538b37 tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:03 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:35:03 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8996ea87-40a4-4e23-b983-0c805ffaa6f9 tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "cinder-adaa01da-6303-4cf7-b15c-a0ea222313fa-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8996ea87-40a4-4e23-b983-0c805ffaa6f9 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-adaa01da-6303-4cf7-b15c-a0ea222313fa-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8996ea87-40a4-4e23-b983-0c805ffaa6f9 tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "cinder-quobyte-adaa01da-6303-4cf7-b15c-a0ea222313fa" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8996ea87-40a4-4e23-b983-0c805ffaa6f9 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-quobyte-adaa01da-6303-4cf7-b15c-a0ea222313fa" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:04 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed40afa0-0eeb-4263-b33d-a125998ffd71]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8996ea87-40a4-4e23-b983-0c805ffaa6f9 tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-adaa01da-6303-4cf7-b15c-a0ea222313fa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:04 devstack sudo[95393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-adaa01da-6303-4cf7-b15c-a0ea222313fa Jul 08 14:35:04 devstack sudo[95393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:04 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c4605cf-5693-4763-914c-fddb7c48a43d -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.86e09cb7-b433-4306-a784-24b445409fb6" returned: 0 in 0.903s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:04 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.86e09cb7-b433-4306-a784-24b445409fb6 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:35:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.86e09cb7-b433-4306-a784-24b445409fb6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:04 devstack sudo[95397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.86e09cb7-b433-4306-a784-24b445409fb6 Jul 08 14:35:04 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:04 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2b3dcbee-579f-4a6d-8525-64a1e5538b37 tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.815s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:04 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-2b3dcbee-579f-4a6d-8525-64a1e5538b37 tempest-CreateVolumesFromSnapshotTest-730689828 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:04 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2b3dcbee-579f-4a6d-8525-64a1e5538b37 tempest-CreateVolumesFromSnapshotTest-730689828 None] Deleted volume successfully. Jul 08 14:35:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2b3dcbee-579f-4a6d-8525-64a1e5538b37 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-88ebc10b-7755-43e2-a411-702b8dabb4f7-delete_volume" released by "delete_volume" :: held 2.861s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:05 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.86e09cb7-b433-4306-a784-24b445409fb6" returned: 0 in 0.780s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:05 devstack sudo[95393]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8996ea87-40a4-4e23-b983-0c805ffaa6f9 tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-adaa01da-6303-4cf7-b15c-a0ea222313fa" returned: 0 in 0.971s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8996ea87-40a4-4e23-b983-0c805ffaa6f9 tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-adaa01da-6303-4cf7-b15c-a0ea222313fa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:05 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-adaa01da-6303-4cf7-b15c-a0ea222313fa Jul 08 14:35:05 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:05 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.info Jul 08 14:35:05 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:05 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8996ea87-40a4-4e23-b983-0c805ffaa6f9 tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-adaa01da-6303-4cf7-b15c-a0ea222313fa" returned: 0 in 0.744s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8996ea87-40a4-4e23-b983-0c805ffaa6f9 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-quobyte-adaa01da-6303-4cf7-b15c-a0ea222313fa" released by "delete_volume" :: held 1.788s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:06 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.info" returned: 0 in 0.741s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:06 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:35:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:06 devstack sudo[95416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.info Jul 08 14:35:06 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:06 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-8996ea87-40a4-4e23-b983-0c805ffaa6f9 tempest-CreateVolumesFromSnapshotTest-730689828 None] Created reservations ['c11f8d96-e3c2-4ccc-a524-20187722afd7', '1cfe7aaf-216b-44c8-8179-0a6eaa67abc8', 'ddc27fed-b148-4a55-965a-784bccb13e3d', '7b14a272-864b-4860-8f61-df1650562e8a'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8996ea87-40a4-4e23-b983-0c805ffaa6f9 tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8996ea87-40a4-4e23-b983-0c805ffaa6f9 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8996ea87-40a4-4e23-b983-0c805ffaa6f9 tempest-CreateVolumesFromSnapshotTest-730689828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8996ea87-40a4-4e23-b983-0c805ffaa6f9 tempest-CreateVolumesFromSnapshotTest-730689828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8996ea87-40a4-4e23-b983-0c805ffaa6f9 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8996ea87-40a4-4e23-b983-0c805ffaa6f9 tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:06 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:35:06 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-872b55f1-f6ea-4630-8091-f6a20fec33df tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "cinder-46f418a4-e277-44ef-807e-bd4e8938fcbf-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-872b55f1-f6ea-4630-8091-f6a20fec33df tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-46f418a4-e277-44ef-807e-bd4e8938fcbf-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-872b55f1-f6ea-4630-8091-f6a20fec33df tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "cinder-quobyte-46f418a4-e277-44ef-807e-bd4e8938fcbf" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-872b55f1-f6ea-4630-8091-f6a20fec33df tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-quobyte-46f418a4-e277-44ef-807e-bd4e8938fcbf" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:06 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f53a30b-de51-47f4-bfea-72bc8ba9031e]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-872b55f1-f6ea-4630-8091-f6a20fec33df tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-46f418a4-e277-44ef-807e-bd4e8938fcbf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:06 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-46f418a4-e277-44ef-807e-bd4e8938fcbf Jul 08 14:35:06 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:07 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.info" returned: 0 in 0.994s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.468s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.457s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-372601728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80bcb236-9e31-4f4f-8a07-3838b2dc3162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d062e082db7742238b6f385a58219200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:34:50Z,use_quota=True,user_id='2696c54e57e34664b020376dc42b27e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Creating volume 80bcb236-9e31-4f4f-8a07-3838b2dc3162 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:35:07 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-80bcb236-9e31-4f4f-8a07-3838b2dc3162 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:07 devstack sudo[95441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-80bcb236-9e31-4f4f-8a07-3838b2dc3162 1073741824 Jul 08 14:35:07 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-38e0f1db-89bc-4566-ad0a-6ef47914b8b6 tempest-GroupSnapshotsTest-449637402 None] group_snapshot efeaad87-a174-4198-a494-782bc9e31852: created successfully Jul 08 14:35:07 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8996ea87-40a4-4e23-b983-0c805ffaa6f9 tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.301s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:07 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-8996ea87-40a4-4e23-b983-0c805ffaa6f9 tempest-CreateVolumesFromSnapshotTest-730689828 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8996ea87-40a4-4e23-b983-0c805ffaa6f9 tempest-CreateVolumesFromSnapshotTest-730689828 None] Deleted volume successfully. Jul 08 14:35:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8996ea87-40a4-4e23-b983-0c805ffaa6f9 tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-adaa01da-6303-4cf7-b15c-a0ea222313fa-delete_volume" released by "delete_volume" :: held 3.488s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] group_snapshot efeaad87-a174-4198-a494-782bc9e31852: deleting Jul 08 14:35:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] group_snapshot efeaad87-a174-4198-a494-782bc9e31852: deleting {{(pid=87240) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 14:35:07 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-872b55f1-f6ea-4630-8091-f6a20fec33df tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-46f418a4-e277-44ef-807e-bd4e8938fcbf" returned: 0 in 1.384s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-872b55f1-f6ea-4630-8091-f6a20fec33df tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-46f418a4-e277-44ef-807e-bd4e8938fcbf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "cinder-quobyte-ab4a3250-44d3-4fa2-9148-ff1557e883d2" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:07 devstack sudo[95449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-46f418a4-e277-44ef-807e-bd4e8938fcbf Jul 08 14:35:07 devstack sudo[95449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-ab4a3250-44d3-4fa2-9148-ff1557e883d2" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "cinder-quobyte-0eb5da36-82bd-4cf4-8150-d2742cb4b92b" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-0eb5da36-82bd-4cf4-8150-d2742cb4b92b" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Deleting offline snapshot 0eb5da36-82bd-4cf4-8150-d2742cb4b92b of volume ab4a3250-44d3-4fa2-9148-ff1557e883d2 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:35:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] snapshot_file for this snap is: volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.0eb5da36-82bd-4cf4-8150-d2742cb4b92b {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:35:08 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7b25d2-2a88-44d7-b59b-b1d2a9ac723c]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.0eb5da36-82bd-4cf4-8150-d2742cb4b92b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:08 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.0eb5da36-82bd-4cf4-8150-d2742cb4b92b Jul 08 14:35:08 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:08 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-80bcb236-9e31-4f4f-8a07-3838b2dc3162 1073741824" returned: 0 in 1.778s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-80bcb236-9e31-4f4f-8a07-3838b2dc3162 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:08 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-80bcb236-9e31-4f4f-8a07-3838b2dc3162 Jul 08 14:35:08 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:09 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.0eb5da36-82bd-4cf4-8150-d2742cb4b92b" returned: 0 in 1.333s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:35:09 devstack sudo[95449]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-872b55f1-f6ea-4630-8091-f6a20fec33df tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-46f418a4-e277-44ef-807e-bd4e8938fcbf" returned: 0 in 1.584s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:09 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b88d03-5a3b-4e36-bc92-6e97352670f1]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-872b55f1-f6ea-4630-8091-f6a20fec33df tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-quobyte-46f418a4-e277-44ef-807e-bd4e8938fcbf" released by "delete_volume" :: held 3.043s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:09 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-872b55f1-f6ea-4630-8091-f6a20fec33df tempest-CreateVolumesFromSnapshotTest-730689828 None] Created reservations ['8614adc7-7ced-4ff1-a7c6-bec971ddd212', '175a202e-9569-4be1-a0e8-29cfb70ef77f', '6b07b638-3ace-4ac4-a890-80da656bc3e0', '2fc480cf-e6ab-441c-adab-a9065e0dbddb'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:09 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2 Jul 08 14:35:09 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-872b55f1-f6ea-4630-8091-f6a20fec33df tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-872b55f1-f6ea-4630-8091-f6a20fec33df tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-872b55f1-f6ea-4630-8091-f6a20fec33df tempest-CreateVolumesFromSnapshotTest-730689828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-872b55f1-f6ea-4630-8091-f6a20fec33df tempest-CreateVolumesFromSnapshotTest-730689828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-872b55f1-f6ea-4630-8091-f6a20fec33df tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-872b55f1-f6ea-4630-8091-f6a20fec33df tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:09 devstack sudo[95468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:35:09 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f9c3a199-f4a9-41bf-8e5c-a1bacb03a8bb tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "cinder-eadafc07-4121-41fe-a8bf-bf12ba59f845-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f9c3a199-f4a9-41bf-8e5c-a1bacb03a8bb tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-eadafc07-4121-41fe-a8bf-bf12ba59f845-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f9c3a199-f4a9-41bf-8e5c-a1bacb03a8bb tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "cinder-quobyte-422deb14-5724-44e2-826b-64ff257828f5" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f9c3a199-f4a9-41bf-8e5c-a1bacb03a8bb tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-quobyte-422deb14-5724-44e2-826b-64ff257828f5" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f9c3a199-f4a9-41bf-8e5c-a1bacb03a8bb tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "cinder-quobyte-eadafc07-4121-41fe-a8bf-bf12ba59f845" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f9c3a199-f4a9-41bf-8e5c-a1bacb03a8bb tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-quobyte-eadafc07-4121-41fe-a8bf-bf12ba59f845" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f9c3a199-f4a9-41bf-8e5c-a1bacb03a8bb tempest-CreateVolumesFromSnapshotTest-730689828 None] Deleting offline snapshot eadafc07-4121-41fe-a8bf-bf12ba59f845 of volume 422deb14-5724-44e2-826b-64ff257828f5 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:35:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f9c3a199-f4a9-41bf-8e5c-a1bacb03a8bb tempest-CreateVolumesFromSnapshotTest-730689828 None] snapshot_file for this snap is: volume-422deb14-5724-44e2-826b-64ff257828f5.eadafc07-4121-41fe-a8bf-bf12ba59f845 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:35:10 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:10 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[95516180-f657-4343-923f-220a4d7cff6b]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f9c3a199-f4a9-41bf-8e5c-a1bacb03a8bb tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.eadafc07-4121-41fe-a8bf-bf12ba59f845 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-80bcb236-9e31-4f4f-8a07-3838b2dc3162" returned: 0 in 1.331s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] <== create_volume: return (3202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:35:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.210s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ecb7543-c503-4ca7-9674-62f8aa08092b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80bcb236-9e31-4f4f-8a07-3838b2dc3162', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eca5c02-bb60-4870-b87f-fa24c973d4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:10 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Volume volume-80bcb236-9e31-4f4f-8a07-3838b2dc3162 (80bcb236-9e31-4f4f-8a07-3838b2dc3162): created successfully Jul 08 14:35:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eca5c02-bb60-4870-b87f-fa24c973d4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Flow 'volume_create_manager' (3ee1b5e7-6634-47b4-8e02-760fee44eabe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:10 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7bba8226-4eb5-4549-9b45-3d1b5c31c20d tempest-VolumesActionsTest-1035642129 None] Created volume successfully. Jul 08 14:35:10 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.eadafc07-4121-41fe-a8bf-bf12ba59f845 Jul 08 14:35:10 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ec6e93ff-81f3-4e41-9264-c4e1f15f51bd tempest-VolumesActionsTest-1035642129 None] Acquiring lock "cinder-80bcb236-9e31-4f4f-8a07-3838b2dc3162" by "attach_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ec6e93ff-81f3-4e41-9264-c4e1f15f51bd tempest-VolumesActionsTest-1035642129 None] Lock "cinder-80bcb236-9e31-4f4f-8a07-3838b2dc3162" acquired by "attach_volume" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:10 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ec6e93ff-81f3-4e41-9264-c4e1f15f51bd tempest-VolumesActionsTest-1035642129 None] Attaching volume 80bcb236-9e31-4f4f-8a07-3838b2dc3162 to instance 88f0b9da-e9ab-4e79-9489-7e8065b48e74 at mountpoint /dev/vdb on host None. Jul 08 14:35:10 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ec6e93ff-81f3-4e41-9264-c4e1f15f51bd tempest-VolumesActionsTest-1035642129 None] Attach volume completed successfully. Jul 08 14:35:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ec6e93ff-81f3-4e41-9264-c4e1f15f51bd tempest-VolumesActionsTest-1035642129 None] Lock "cinder-80bcb236-9e31-4f4f-8a07-3838b2dc3162" released by "attach_volume" :: held 0.159s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:10 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2" returned: 0 in 1.446s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.0eb5da36-82bd-4cf4-8150-d2742cb4b92b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:10 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.0eb5da36-82bd-4cf4-8150-d2742cb4b92b Jul 08 14:35:10 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:11 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-872b55f1-f6ea-4630-8091-f6a20fec33df tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.272s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:11 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-872b55f1-f6ea-4630-8091-f6a20fec33df tempest-CreateVolumesFromSnapshotTest-730689828 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:11 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-872b55f1-f6ea-4630-8091-f6a20fec33df tempest-CreateVolumesFromSnapshotTest-730689828 None] Deleted volume successfully. Jul 08 14:35:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-872b55f1-f6ea-4630-8091-f6a20fec33df tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-46f418a4-e277-44ef-807e-bd4e8938fcbf-delete_volume" released by "delete_volume" :: held 4.659s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:11 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f9c3a199-f4a9-41bf-8e5c-a1bacb03a8bb tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.eadafc07-4121-41fe-a8bf-bf12ba59f845" returned: 0 in 1.338s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f9c3a199-f4a9-41bf-8e5c-a1bacb03a8bb tempest-CreateVolumesFromSnapshotTest-730689828 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-422deb14-5724-44e2-826b-64ff257828f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:35:11 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[16589c93-1eda-4b24-b2f1-55eeee07fd66]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f9c3a199-f4a9-41bf-8e5c-a1bacb03a8bb tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:11 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-14042f2b-b0eb-45c2-9b89-baed301e4b95 tempest-VolumesActionsTest-2064437360 None] Terminate volume connection completed successfully. Jul 08 14:35:11 devstack sudo[95483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5 Jul 08 14:35:11 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:12 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.0eb5da36-82bd-4cf4-8150-d2742cb4b92b" returned: 0 in 1.051s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.0eb5da36-82bd-4cf4-8150-d2742cb4b92b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:12 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.0eb5da36-82bd-4cf4-8150-d2742cb4b92b Jul 08 14:35:12 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-14042f2b-b0eb-45c2-9b89-baed301e4b95 tempest-VolumesActionsTest-2064437360 None] Acquiring lock "cinder-80bcb236-9e31-4f4f-8a07-3838b2dc3162-detach_volume" by "detach_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-14042f2b-b0eb-45c2-9b89-baed301e4b95 tempest-VolumesActionsTest-2064437360 None] Lock "cinder-80bcb236-9e31-4f4f-8a07-3838b2dc3162-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:12 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-14042f2b-b0eb-45c2-9b89-baed301e4b95 tempest-VolumesActionsTest-2064437360 None] Detaching volume 80bcb236-9e31-4f4f-8a07-3838b2dc3162 from instance 88f0b9da-e9ab-4e79-9489-7e8065b48e74. Jul 08 14:35:12 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-14042f2b-b0eb-45c2-9b89-baed301e4b95 tempest-VolumesActionsTest-2064437360 None] Detach volume completed successfully. Jul 08 14:35:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-14042f2b-b0eb-45c2-9b89-baed301e4b95 tempest-VolumesActionsTest-2064437360 None] Lock "cinder-80bcb236-9e31-4f4f-8a07-3838b2dc3162-detach_volume" released by "detach_volume" :: held 0.110s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:12 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f9c3a199-f4a9-41bf-8e5c-a1bacb03a8bb tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5" returned: 0 in 0.956s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f9c3a199-f4a9-41bf-8e5c-a1bacb03a8bb tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.eadafc07-4121-41fe-a8bf-bf12ba59f845 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:12 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.eadafc07-4121-41fe-a8bf-bf12ba59f845 Jul 08 14:35:12 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:12 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2.0eb5da36-82bd-4cf4-8150-d2742cb4b92b" returned: 0 in 0.745s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-0eb5da36-82bd-4cf4-8150-d2742cb4b92b" released by "_delete_snapshot" :: held 4.775s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-ab4a3250-44d3-4fa2-9148-ff1557e883d2" released by "delete_snapshot" :: held 4.834s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "cinder-quobyte-8c4605cf-5693-4763-914c-fddb7c48a43d" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-8c4605cf-5693-4763-914c-fddb7c48a43d" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "cinder-quobyte-86e09cb7-b433-4306-a784-24b445409fb6" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-86e09cb7-b433-4306-a784-24b445409fb6" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Deleting offline snapshot 86e09cb7-b433-4306-a784-24b445409fb6 of volume 8c4605cf-5693-4763-914c-fddb7c48a43d {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:35:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] snapshot_file for this snap is: volume-8c4605cf-5693-4763-914c-fddb7c48a43d.86e09cb7-b433-4306-a784-24b445409fb6 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:35:12 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3a8435-1474-4068-be96-fef05b3bd004]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.86e09cb7-b433-4306-a784-24b445409fb6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2faf2a75-40b0-4f8e-aa4b-0292730ba0ca tempest-VolumesActionsTest-1035642129 None] Acquiring lock "cinder-80bcb236-9e31-4f4f-8a07-3838b2dc3162-detach_volume" by "detach_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2faf2a75-40b0-4f8e-aa4b-0292730ba0ca tempest-VolumesActionsTest-1035642129 None] Lock "cinder-80bcb236-9e31-4f4f-8a07-3838b2dc3162-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:13 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2faf2a75-40b0-4f8e-aa4b-0292730ba0ca tempest-VolumesActionsTest-1035642129 None] Volume detach called, but volume not attached. Jul 08 14:35:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2faf2a75-40b0-4f8e-aa4b-0292730ba0ca tempest-VolumesActionsTest-1035642129 None] Lock "cinder-80bcb236-9e31-4f4f-8a07-3838b2dc3162-detach_volume" released by "detach_volume" :: held 0.043s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:13 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.86e09cb7-b433-4306-a784-24b445409fb6 Jul 08 14:35:13 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:13 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f9c3a199-f4a9-41bf-8e5c-a1bacb03a8bb tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.eadafc07-4121-41fe-a8bf-bf12ba59f845" returned: 0 in 1.067s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f9c3a199-f4a9-41bf-8e5c-a1bacb03a8bb tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.eadafc07-4121-41fe-a8bf-bf12ba59f845 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:13 devstack sudo[95501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.eadafc07-4121-41fe-a8bf-bf12ba59f845 Jul 08 14:35:13 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a734e088-b166-4ac5-a8d3-8d59550e8927 tempest-VolumesActionsTest-1035642129 None] Acquiring lock "cinder-80bcb236-9e31-4f4f-8a07-3838b2dc3162-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a734e088-b166-4ac5-a8d3-8d59550e8927 tempest-VolumesActionsTest-1035642129 None] Lock "cinder-80bcb236-9e31-4f4f-8a07-3838b2dc3162-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a734e088-b166-4ac5-a8d3-8d59550e8927 tempest-VolumesActionsTest-1035642129 None] Acquiring lock "cinder-quobyte-80bcb236-9e31-4f4f-8a07-3838b2dc3162" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a734e088-b166-4ac5-a8d3-8d59550e8927 tempest-VolumesActionsTest-1035642129 None] Lock "cinder-quobyte-80bcb236-9e31-4f4f-8a07-3838b2dc3162" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:14 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c58fe3a-6e69-447b-b283-c475f12b274c]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a734e088-b166-4ac5-a8d3-8d59550e8927 tempest-VolumesActionsTest-1035642129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-80bcb236-9e31-4f4f-8a07-3838b2dc3162 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:14 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.86e09cb7-b433-4306-a784-24b445409fb6" returned: 0 in 1.070s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c4605cf-5693-4763-914c-fddb7c48a43d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:35:14 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6526fd12-b118-41ff-8338-ed369edfc695]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:14 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-80bcb236-9e31-4f4f-8a07-3838b2dc3162 Jul 08 14:35:14 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:14 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d Jul 08 14:35:14 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:14 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f9c3a199-f4a9-41bf-8e5c-a1bacb03a8bb tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5.eadafc07-4121-41fe-a8bf-bf12ba59f845" returned: 0 in 1.010s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f9c3a199-f4a9-41bf-8e5c-a1bacb03a8bb tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-quobyte-eadafc07-4121-41fe-a8bf-bf12ba59f845" released by "_delete_snapshot" :: held 4.550s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f9c3a199-f4a9-41bf-8e5c-a1bacb03a8bb tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-quobyte-422deb14-5724-44e2-826b-64ff257828f5" released by "delete_snapshot" :: held 4.599s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:14 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-f9c3a199-f4a9-41bf-8e5c-a1bacb03a8bb tempest-CreateVolumesFromSnapshotTest-730689828 None] Created reservations ['71b9c950-d837-4fb1-8eda-17cb5382be1b', '0d33b004-7c93-4090-b166-309fd3abb297', 'dbe38973-1d73-428c-a7d0-e85471a2d84a', 'ae830dd1-b8f4-4450-814f-f6364a604229'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:14 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f9c3a199-f4a9-41bf-8e5c-a1bacb03a8bb tempest-CreateVolumesFromSnapshotTest-730689828 None] Delete snapshot completed successfully. Jul 08 14:35:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f9c3a199-f4a9-41bf-8e5c-a1bacb03a8bb tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-eadafc07-4121-41fe-a8bf-bf12ba59f845-delete_snapshot" released by "delete_snapshot" :: held 4.842s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:15 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a734e088-b166-4ac5-a8d3-8d59550e8927 tempest-VolumesActionsTest-1035642129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-80bcb236-9e31-4f4f-8a07-3838b2dc3162" returned: 0 in 1.131s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a734e088-b166-4ac5-a8d3-8d59550e8927 tempest-VolumesActionsTest-1035642129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-80bcb236-9e31-4f4f-8a07-3838b2dc3162 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:15 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-80bcb236-9e31-4f4f-8a07-3838b2dc3162 Jul 08 14:35:15 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:15 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d" returned: 0 in 1.157s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.86e09cb7-b433-4306-a784-24b445409fb6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:15 devstack sudo[95520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.86e09cb7-b433-4306-a784-24b445409fb6 Jul 08 14:35:15 devstack sudo[95520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e49d44de-5b66-438d-8fd9-df4bdf398b6d tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "cinder-422deb14-5724-44e2-826b-64ff257828f5-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e49d44de-5b66-438d-8fd9-df4bdf398b6d tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-422deb14-5724-44e2-826b-64ff257828f5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e49d44de-5b66-438d-8fd9-df4bdf398b6d tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "cinder-quobyte-422deb14-5724-44e2-826b-64ff257828f5" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e49d44de-5b66-438d-8fd9-df4bdf398b6d tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-quobyte-422deb14-5724-44e2-826b-64ff257828f5" acquired by "delete_volume" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:15 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4b562d-9017-42f6-9b69-229d4f03e585]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e49d44de-5b66-438d-8fd9-df4bdf398b6d tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:15 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5 Jul 08 14:35:15 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:15 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a734e088-b166-4ac5-a8d3-8d59550e8927 tempest-VolumesActionsTest-1035642129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-80bcb236-9e31-4f4f-8a07-3838b2dc3162" returned: 0 in 0.801s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a734e088-b166-4ac5-a8d3-8d59550e8927 tempest-VolumesActionsTest-1035642129 None] Lock "cinder-quobyte-80bcb236-9e31-4f4f-8a07-3838b2dc3162" released by "delete_volume" :: held 2.000s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:16 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-a734e088-b166-4ac5-a8d3-8d59550e8927 tempest-VolumesActionsTest-1035642129 None] Created reservations ['c84ca3ad-ff37-4363-9c76-52d6428cf42d', '4fbb1c45-6fff-4a7b-adaf-be4ff9edc644', '41e1791b-3a1e-48a7-a309-5817e2455082', 'b5c7ea45-dca6-4a68-a3e2-19577e0b5288'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:16 devstack sudo[95520]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.86e09cb7-b433-4306-a784-24b445409fb6" returned: 0 in 0.960s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.86e09cb7-b433-4306-a784-24b445409fb6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a734e088-b166-4ac5-a8d3-8d59550e8927 tempest-VolumesActionsTest-1035642129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a734e088-b166-4ac5-a8d3-8d59550e8927 tempest-VolumesActionsTest-1035642129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a734e088-b166-4ac5-a8d3-8d59550e8927 tempest-VolumesActionsTest-1035642129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a734e088-b166-4ac5-a8d3-8d59550e8927 tempest-VolumesActionsTest-1035642129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a734e088-b166-4ac5-a8d3-8d59550e8927 tempest-VolumesActionsTest-1035642129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a734e088-b166-4ac5-a8d3-8d59550e8927 tempest-VolumesActionsTest-1035642129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:16 devstack sudo[95528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.86e09cb7-b433-4306-a784-24b445409fb6 Jul 08 14:35:16 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:16 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:35:16 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:16 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-18fea4aa-355e-4db3-95cc-5f3c9e1b5707 req-68533a52-8eb6-42d8-bbae-c4620d5fe295 tempest-AttachVolumeNegativeTest-1089741081 None] Terminate volume connection completed successfully. Jul 08 14:35:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-18fea4aa-355e-4db3-95cc-5f3c9e1b5707 req-68533a52-8eb6-42d8-bbae-c4620d5fe295 tempest-AttachVolumeNegativeTest-1089741081 None] Deleting attachment 00442aec-d23a-41b6-84f8-a9cd7a0404e9. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:35:16 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e49d44de-5b66-438d-8fd9-df4bdf398b6d tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5" returned: 0 in 0.975s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e49d44de-5b66-438d-8fd9-df4bdf398b6d tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:16 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5 Jul 08 14:35:16 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:16 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a734e088-b166-4ac5-a8d3-8d59550e8927 tempest-VolumesActionsTest-1035642129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.737s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:16 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-a734e088-b166-4ac5-a8d3-8d59550e8927 tempest-VolumesActionsTest-1035642129 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:16 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a734e088-b166-4ac5-a8d3-8d59550e8927 tempest-VolumesActionsTest-1035642129 None] Deleted volume successfully. Jul 08 14:35:16 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:INSERT=28,cinder:UPDATE=117,cinder:SELECT=106,cinder:DELETE=11 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:35:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a734e088-b166-4ac5-a8d3-8d59550e8927 tempest-VolumesActionsTest-1035642129 None] Lock "cinder-80bcb236-9e31-4f4f-8a07-3838b2dc3162-delete_volume" released by "delete_volume" :: held 3.155s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:17 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d.86e09cb7-b433-4306-a784-24b445409fb6" returned: 0 in 0.999s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-86e09cb7-b433-4306-a784-24b445409fb6" released by "_delete_snapshot" :: held 4.331s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-8c4605cf-5693-4763-914c-fddb7c48a43d" released by "delete_snapshot" :: held 4.375s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:17 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e49d44de-5b66-438d-8fd9-df4bdf398b6d tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422deb14-5724-44e2-826b-64ff257828f5" returned: 0 in 0.800s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e49d44de-5b66-438d-8fd9-df4bdf398b6d tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-quobyte-422deb14-5724-44e2-826b-64ff257828f5" released by "delete_volume" :: held 1.860s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:17 devstack cinder-volume[87240]: WARNING cinder.quota [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-100633407 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-100633407, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:35:17 devstack cinder-volume[87240]: WARNING cinder.quota [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-100633407 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-100633407, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:35:17 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Created reservations ['5162fa00-c258-4c16-9623-1703fc540e58', 'fa0397a0-31cb-4c41-a325-c222c0973931', '200037e2-5b16-48d7-94fe-24b373d2df7a', 'ae409a11-70b0-41b2-a8e9-e38c9d859c87'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:17 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-e49d44de-5b66-438d-8fd9-df4bdf398b6d tempest-CreateVolumesFromSnapshotTest-730689828 None] Created reservations ['f0e6d1eb-daa8-411e-99cf-cd3fa989ec85', '67f9363d-2a57-4e9c-8b5a-562384db794c', 'a3abaaf5-ddbc-4deb-bf11-5d08f88b62b9', 'e1c5db0c-21d9-4864-b345-32b03c7286b9'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e49d44de-5b66-438d-8fd9-df4bdf398b6d tempest-CreateVolumesFromSnapshotTest-730689828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e49d44de-5b66-438d-8fd9-df4bdf398b6d tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e49d44de-5b66-438d-8fd9-df4bdf398b6d tempest-CreateVolumesFromSnapshotTest-730689828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e49d44de-5b66-438d-8fd9-df4bdf398b6d tempest-CreateVolumesFromSnapshotTest-730689828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e49d44de-5b66-438d-8fd9-df4bdf398b6d tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e49d44de-5b66-438d-8fd9-df4bdf398b6d tempest-CreateVolumesFromSnapshotTest-730689828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:17 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:35:17 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:17 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] Created reservations ['190686a0-ff3f-461e-9f02-fbb12fc8c55c', '562cda01-d78d-4288-b13b-ed6963c7a8f7', '0a97708c-e37e-4455-88fb-f67c1644e9d0', 'f0c3eb8a-c5a1-45eb-9bc0-4dc279242cfc'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:17 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-829719bc-803e-4e69-85b2-3637188189ad tempest-GroupSnapshotsTest-449637402 None] group_snapshot efeaad87-a174-4198-a494-782bc9e31852: deleted successfully Jul 08 14:35:18 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e49d44de-5b66-438d-8fd9-df4bdf398b6d tempest-CreateVolumesFromSnapshotTest-730689828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.893s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:18 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-e49d44de-5b66-438d-8fd9-df4bdf398b6d tempest-CreateVolumesFromSnapshotTest-730689828 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:18 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e49d44de-5b66-438d-8fd9-df4bdf398b6d tempest-CreateVolumesFromSnapshotTest-730689828 None] Deleted volume successfully. Jul 08 14:35:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "cinder-quobyte-8c4605cf-5693-4763-914c-fddb7c48a43d" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e49d44de-5b66-438d-8fd9-df4bdf398b6d tempest-CreateVolumesFromSnapshotTest-730689828 None] Lock "cinder-422deb14-5724-44e2-826b-64ff257828f5-delete_volume" released by "delete_volume" :: held 3.075s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-8c4605cf-5693-4763-914c-fddb7c48a43d" acquired by "delete_volume" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:18 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6eb010-a02e-492e-b352-930d59ca04af]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:18 devstack sudo[95547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d Jul 08 14:35:18 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:19 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d" returned: 0 in 1.127s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:19 devstack sudo[95573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d Jul 08 14:35:19 devstack sudo[95573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:20 devstack sudo[95573]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c4605cf-5693-4763-914c-fddb7c48a43d" returned: 0 in 0.979s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-8c4605cf-5693-4763-914c-fddb7c48a43d" released by "delete_volume" :: held 2.221s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "cinder-quobyte-ab4a3250-44d3-4fa2-9148-ff1557e883d2" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-ab4a3250-44d3-4fa2-9148-ff1557e883d2" acquired by "delete_volume" :: waited 0.039s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:20 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d7bf1e-e65a-416e-98c9-c459e002382c]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:21 devstack sudo[95595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2 Jul 08 14:35:21 devstack sudo[95595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:22 devstack sudo[95595]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2" returned: 0 in 1.152s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:22 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2 Jul 08 14:35:22 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Flow 'volume_create_manager' (7ecacd9f-6b34-43f3-8495-bb7e3b7ec684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f42a138-af63-4f76-9cdb-05dfef530cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f42a138-af63-4f76-9cdb-05dfef530cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1476706827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feae6f19-509a-435e-b776-6dd7e1a29a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d598209329954e98b011f6800096b479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:23Z,use_quota=True,user_id='bd0b924fe29b4cfeae5d00eac2a11317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7790145c-a2a0-4b8b-ad1c-6e78c6b245a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7790145c-a2a0-4b8b-ad1c-6e78c6b245a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590e98d3-a3be-4696-927c-70b7e1423b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (590e98d3-a3be-4696-927c-70b7e1423b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'feae6f19-509a-435e-b776-6dd7e1a29a6f', 'volume_name': 'volume-feae6f19-509a-435e-b776-6dd7e1a29a6f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd187592-2259-42ec-b98e-aeafb896321e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd187592-2259-42ec-b98e-aeafb896321e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f0443f8-5df9-4c59-9f31-1a593242d299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:22 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Volume feae6f19-509a-435e-b776-6dd7e1a29a6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-feae6f19-509a-435e-b776-6dd7e1a29a6f', 'volume_size': 1} Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1476706827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=feae6f19-509a-435e-b776-6dd7e1a29a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d598209329954e98b011f6800096b479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:23Z,use_quota=True,user_id='bd0b924fe29b4cfeae5d00eac2a11317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Creating volume feae6f19-509a-435e-b776-6dd7e1a29a6f {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:35:22 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:35:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-feae6f19-509a-435e-b776-6dd7e1a29a6f 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:22 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-feae6f19-509a-435e-b776-6dd7e1a29a6f 1073741824 Jul 08 14:35:22 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:23 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab4a3250-44d3-4fa2-9148-ff1557e883d2" returned: 0 in 1.015s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-ab4a3250-44d3-4fa2-9148-ff1557e883d2" released by "delete_volume" :: held 2.324s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:23 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] Created reservations ['6fcff3a8-b8d5-4bb1-99d5-3bd64f7229ec'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:23 devstack cinder-volume[87240]: WARNING cinder.quota [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-100633407 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-100633407, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:35:23 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] Created reservations ['3b033e79-c970-4961-a457-6494664a4a57', 'e5143b70-7daf-460c-a478-5a3d144bfdba', '045f422d-e73a-444a-8ea2-1e5a4816d9b3', 'd8928e6f-e57e-4a8d-8bcf-776b53c389dd'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:23 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] Created reservations ['ec474434-6986-479f-aebf-541f2c85ae62', '9eb87f9d-91b5-46dc-9f27-bf566cb1fa1f', '92d55b5c-197f-4027-b89e-ee25adc0fccb', '3b0030cd-0504-400e-a1cd-24b956d2399d'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:23 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:35:23 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:24 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-feae6f19-509a-435e-b776-6dd7e1a29a6f 1073741824" returned: 0 in 1.323s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-feae6f19-509a-435e-b776-6dd7e1a29a6f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:24 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-feae6f19-509a-435e-b776-6dd7e1a29a6f Jul 08 14:35:24 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:24 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e11a5f8e-07c2-44a3-bc91-26a3a477adf1 tempest-GroupSnapshotsTest-449637402 None] Group tempest-GroupSnapshotsTest-Group-1827834281: creating Jul 08 14:35:24 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e11a5f8e-07c2-44a3-bc91-26a3a477adf1 tempest-GroupSnapshotsTest-449637402 None] Group tempest-GroupSnapshotsTest-Group-1827834281: created successfully Jul 08 14:35:24 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e11a5f8e-07c2-44a3-bc91-26a3a477adf1 tempest-GroupSnapshotsTest-449637402 None] Create group completed successfully. Jul 08 14:35:24 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.981s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:24 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:24 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-780d0ff1-49d3-4be2-8574-8bae678ffe10 tempest-GroupSnapshotsTest-449637402 None] Delete group completed successfully. Jul 08 14:35:25 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-feae6f19-509a-435e-b776-6dd7e1a29a6f" returned: 0 in 0.829s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] <== create_volume: return (2213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.216s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f0443f8-5df9-4c59-9f31-1a593242d299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-feae6f19-509a-435e-b776-6dd7e1a29a6f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3205201d-413a-4db2-9a02-801d5ca9bcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=117,cinder:INSERT=33,cinder:UPDATE=146,cinder:DELETE=7 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:35:25 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Volume volume-feae6f19-509a-435e-b776-6dd7e1a29a6f (feae6f19-509a-435e-b776-6dd7e1a29a6f): created successfully Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3205201d-413a-4db2-9a02-801d5ca9bcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Flow 'volume_create_manager' (7ecacd9f-6b34-43f3-8495-bb7e3b7ec684) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Flow 'volume_create_manager' (4a07edc2-372d-42b7-a007-bed14a352cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6b867c-b620-48c6-b184-ca296dd51e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:25 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-eacf9ce8-7025-4312-9232-81c5cb38dcb9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Created volume successfully. Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6b867c-b620-48c6-b184-ca296dd51e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1231867429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea1707c-1f3a-4c63-bda6-7cac9eafc0f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d062e082db7742238b6f385a58219200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:25Z,use_quota=True,user_id='2696c54e57e34664b020376dc42b27e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac11f008-5921-43d4-9ead-9e34bbaf12e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac11f008-5921-43d4-9ead-9e34bbaf12e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc0a6f0-c5a2-4311-99b6-b2664ca92e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfc0a6f0-c5a2-4311-99b6-b2664ca92e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aea1707c-1f3a-4c63-bda6-7cac9eafc0f2', 'volume_name': 'volume-aea1707c-1f3a-4c63-bda6-7cac9eafc0f2', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f470c33d-2535-4593-8882-06175a34ddf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f470c33d-2535-4593-8882-06175a34ddf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88816c2f-39c7-47ee-8f26-713e48894d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:25 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Volume aea1707c-1f3a-4c63-bda6-7cac9eafc0f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aea1707c-1f3a-4c63-bda6-7cac9eafc0f2', 'volume_size': 1} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1231867429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aea1707c-1f3a-4c63-bda6-7cac9eafc0f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d062e082db7742238b6f385a58219200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:25Z,use_quota=True,user_id='2696c54e57e34664b020376dc42b27e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Creating volume aea1707c-1f3a-4c63-bda6-7cac9eafc0f2 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:35:25 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:35:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-aea1707c-1f3a-4c63-bda6-7cac9eafc0f2 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:25 devstack sudo[95624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-aea1707c-1f3a-4c63-bda6-7cac9eafc0f2 1073741824 Jul 08 14:35:25 devstack sudo[95624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Flow 'volume_create_manager' (d290fb9a-d45c-4a75-bbfc-b80b28cdcb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd74e746-8801-4aa0-947e-b3782e6f0453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd74e746-8801-4aa0-947e-b3782e6f0453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-774284838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6fd02a10-5d6e-40e1-b47e-de86f884a18f,host='devstack@QuobyteHD#QuobyteHD',id=4c820a4a-2e93-4730-83fd-69c6e1dec646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869945f21bad402fa334beba41eec722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:26Z,use_quota=True,user_id='2879b4c844094ee4bf2f90016538a11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(379a9fec-37d0-4a59-a536-dc4b359632e2),volume_type_id=379a9fec-37d0-4a59-a536-dc4b359632e2)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3278dc-b7a0-470f-af94-27920ed19a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3278dc-b7a0-470f-af94-27920ed19a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c93e1727-9456-49ec-a274-b55a623aee54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c93e1727-9456-49ec-a274-b55a623aee54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c820a4a-2e93-4730-83fd-69c6e1dec646', 'volume_name': 'volume-4c820a4a-2e93-4730-83fd-69c6e1dec646', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb14405-b920-42be-b249-90ac53ba9645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb14405-b920-42be-b249-90ac53ba9645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f61f1de-9dfe-4f5a-b940-d096741cb96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:26 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Volume 4c820a4a-2e93-4730-83fd-69c6e1dec646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c820a4a-2e93-4730-83fd-69c6e1dec646', 'volume_size': 1} Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:26 devstack sudo[95624]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-aea1707c-1f3a-4c63-bda6-7cac9eafc0f2 1073741824" returned: 0 in 1.176s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-aea1707c-1f3a-4c63-bda6-7cac9eafc0f2 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:26 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-aea1707c-1f3a-4c63-bda6-7cac9eafc0f2 Jul 08 14:35:26 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Flow 'volume_create_manager' (2e5ba29a-e232-4122-afba-7649883e27a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5bd05fe-dab0-4fed-af76-a87eb9ea949d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5bd05fe-dab0-4fed-af76-a87eb9ea949d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1073242128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=567e10d0-af82-4912-8cb5-1ba8b7a5735e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d598209329954e98b011f6800096b479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:26Z,use_quota=True,user_id='bd0b924fe29b4cfeae5d00eac2a11317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfda610-6d9f-4ef8-901e-74393399a4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddfda610-6d9f-4ef8-901e-74393399a4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476e6e24-bb94-4f67-9c84-10bfb6482453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (476e6e24-bb94-4f67-9c84-10bfb6482453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '567e10d0-af82-4912-8cb5-1ba8b7a5735e', 'volume_name': 'volume-567e10d0-af82-4912-8cb5-1ba8b7a5735e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46bbbc0d-ced8-48f2-8ca7-600505007b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46bbbc0d-ced8-48f2-8ca7-600505007b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e51a53e-2b23-49ed-81b7-648b02890844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:26 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Volume 567e10d0-af82-4912-8cb5-1ba8b7a5735e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-567e10d0-af82-4912-8cb5-1ba8b7a5735e', 'volume_size': 1} Jul 08 14:35:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:27 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-aea1707c-1f3a-4c63-bda6-7cac9eafc0f2" returned: 0 in 0.783s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] <== create_volume: return (2004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.979s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6fd02a10-5d6e-40e1-b47e-de86f884a18f,created_at=2026-07-08T12:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-774284838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6fd02a10-5d6e-40e1-b47e-de86f884a18f,host='devstack@QuobyteHD#QuobyteHD',id=4c820a4a-2e93-4730-83fd-69c6e1dec646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='869945f21bad402fa334beba41eec722',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:26Z,use_quota=True,user_id='2879b4c844094ee4bf2f90016538a11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(379a9fec-37d0-4a59-a536-dc4b359632e2),volume_type_id=379a9fec-37d0-4a59-a536-dc4b359632e2)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Creating volume 4c820a4a-2e93-4730-83fd-69c6e1dec646 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:35:27 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:35:27 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646 1073741824 Jul 08 14:35:27 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Flow 'volume_create_manager' (c6e3847b-8020-4088-8b9d-bcd95198a0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fa6e29-788d-40b5-992a-a6d85a2be84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77fa6e29-788d-40b5-992a-a6d85a2be84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1146541893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb0eae48-1888-46c9-b3e7-6926dd19c415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d598209329954e98b011f6800096b479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:27Z,use_quota=True,user_id='bd0b924fe29b4cfeae5d00eac2a11317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b0e1b0-5d25-42af-a0a6-eb932f8fa0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b0e1b0-5d25-42af-a0a6-eb932f8fa0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13be1e10-3886-4428-b944-53603239a08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13be1e10-3886-4428-b944-53603239a08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb0eae48-1888-46c9-b3e7-6926dd19c415', 'volume_name': 'volume-fb0eae48-1888-46c9-b3e7-6926dd19c415', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f218cb96-8c4a-4a14-a993-975dc0936451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f218cb96-8c4a-4a14-a993-975dc0936451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d907dcce-7d29-4116-8909-e4184086cabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:27 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Volume fb0eae48-1888-46c9-b3e7-6926dd19c415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb0eae48-1888-46c9-b3e7-6926dd19c415', 'volume_size': 1} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88816c2f-39c7-47ee-8f26-713e48894d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aea1707c-1f3a-4c63-bda6-7cac9eafc0f2', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2799d143-6dda-48b2-ae0c-21db4fa8bf74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:27 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Volume volume-aea1707c-1f3a-4c63-bda6-7cac9eafc0f2 (aea1707c-1f3a-4c63-bda6-7cac9eafc0f2): created successfully Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2799d143-6dda-48b2-ae0c-21db4fa8bf74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Flow 'volume_create_manager' (4a07edc2-372d-42b7-a007-bed14a352cdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:27 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-16e0ed70-c2e4-4ae1-98f2-518600bdc172 tempest-VolumesActionsTest-1035642129 None] Created volume successfully. Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Flow 'volume_create_manager' (6a3e3794-fc17-495e-b434-8991629b4267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d45fa49-91cc-4632-a4f1-433d8ded0ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d45fa49-91cc-4632-a4f1-433d8ded0ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-440584532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ffb4ecf-dc83-4cdf-9785-2558c70e72a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d598209329954e98b011f6800096b479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:28Z,use_quota=True,user_id='bd0b924fe29b4cfeae5d00eac2a11317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3650a1d-ef47-458e-9b4b-28f3253bb32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3650a1d-ef47-458e-9b4b-28f3253bb32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba3386b-3f13-4e5a-8f4f-c545f09b3628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba3386b-3f13-4e5a-8f4f-c545f09b3628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ffb4ecf-dc83-4cdf-9785-2558c70e72a0', 'volume_name': 'volume-0ffb4ecf-dc83-4cdf-9785-2558c70e72a0', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae35699-77cc-4882-9e4f-bf43873ba8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ae35699-77cc-4882-9e4f-bf43873ba8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb28402-eee1-4b4e-b6fe-5b85a0e3ea90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:27 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Volume 0ffb4ecf-dc83-4cdf-9785-2558c70e72a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ffb4ecf-dc83-4cdf-9785-2558c70e72a0', 'volume_size': 1} Jul 08 14:35:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Flow 'volume_create_manager' (b491a4d2-509d-4165-a0d3-0346b45e1a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dcfefeb-8c2a-441c-b560-e12e6cf54a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dcfefeb-8c2a-441c-b560-e12e6cf54a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1515043041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e150a4f1-0413-43c4-b7e9-7cb72ace2f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d598209329954e98b011f6800096b479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:28Z,use_quota=True,user_id='bd0b924fe29b4cfeae5d00eac2a11317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267a51f5-3ad8-4470-aff9-eaa9e53681d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267a51f5-3ad8-4470-aff9-eaa9e53681d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f50dd6-64e8-4bba-b9e3-d60758c8613b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5f50dd6-64e8-4bba-b9e3-d60758c8613b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e150a4f1-0413-43c4-b7e9-7cb72ace2f58', 'volume_name': 'volume-e150a4f1-0413-43c4-b7e9-7cb72ace2f58', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb2d58a-984b-461b-abe9-811daf52b778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfb2d58a-984b-461b-abe9-811daf52b778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9683d675-dce9-4a36-87df-6d925c9ebf53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:28 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Volume e150a4f1-0413-43c4-b7e9-7cb72ace2f58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e150a4f1-0413-43c4-b7e9-7cb72ace2f58', 'volume_size': 1} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:28 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646 1073741824" returned: 0 in 1.393s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:28 devstack sudo[95639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646 Jul 08 14:35:28 devstack sudo[95639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Flow 'volume_create_manager' (49d6398a-63e2-4ad0-a9cf-62fd278752a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6862d932-23f0-45ff-9fc7-2c9dcc42460b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6862d932-23f0-45ff-9fc7-2c9dcc42460b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2039638198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca27373-601b-4d9d-bd66-01a2fbb0fdcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d598209329954e98b011f6800096b479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:29Z,use_quota=True,user_id='bd0b924fe29b4cfeae5d00eac2a11317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0128ce0-9a50-4777-92e7-b73851e03646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0128ce0-9a50-4777-92e7-b73851e03646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8ae63e-f3fa-496a-b6d0-7c48f8a28a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff8ae63e-f3fa-496a-b6d0-7c48f8a28a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bca27373-601b-4d9d-bd66-01a2fbb0fdcb', 'volume_name': 'volume-bca27373-601b-4d9d-bd66-01a2fbb0fdcb', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f38207-c537-437f-8d98-60729f14f808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6f38207-c537-437f-8d98-60729f14f808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dbc3c43-79a6-4fdc-ba98-78ccfcd1eb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:28 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Volume bca27373-601b-4d9d-bd66-01a2fbb0fdcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bca27373-601b-4d9d-bd66-01a2fbb0fdcb', 'volume_size': 1} Jul 08 14:35:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cd093fdd-d604-46a7-bc7d-c8c5c232cbd7 tempest-VolumesActionsTest-2064437360 None] Acquiring lock "cinder-aea1707c-1f3a-4c63-bda6-7cac9eafc0f2-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cd093fdd-d604-46a7-bc7d-c8c5c232cbd7 tempest-VolumesActionsTest-2064437360 None] Lock "cinder-aea1707c-1f3a-4c63-bda6-7cac9eafc0f2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cd093fdd-d604-46a7-bc7d-c8c5c232cbd7 tempest-VolumesActionsTest-2064437360 None] Acquiring lock "cinder-quobyte-aea1707c-1f3a-4c63-bda6-7cac9eafc0f2" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cd093fdd-d604-46a7-bc7d-c8c5c232cbd7 tempest-VolumesActionsTest-2064437360 None] Lock "cinder-quobyte-aea1707c-1f3a-4c63-bda6-7cac9eafc0f2" acquired by "delete_volume" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:29 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c162bc-282b-43b2-a1f2-10cadfb568ce]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cd093fdd-d604-46a7-bc7d-c8c5c232cbd7 tempest-VolumesActionsTest-2064437360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-aea1707c-1f3a-4c63-bda6-7cac9eafc0f2 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:29 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-aea1707c-1f3a-4c63-bda6-7cac9eafc0f2 Jul 08 14:35:29 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:29 devstack sudo[95639]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646" returned: 0 in 0.840s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] <== create_volume: return (2331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.335s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.943s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1073242128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=567e10d0-af82-4912-8cb5-1ba8b7a5735e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d598209329954e98b011f6800096b479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:26Z,use_quota=True,user_id='bd0b924fe29b4cfeae5d00eac2a11317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Creating volume 567e10d0-af82-4912-8cb5-1ba8b7a5735e {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:35:29 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:35:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-567e10d0-af82-4912-8cb5-1ba8b7a5735e 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f61f1de-9dfe-4f5a-b940-d096741cb96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c820a4a-2e93-4730-83fd-69c6e1dec646', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:29 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-567e10d0-af82-4912-8cb5-1ba8b7a5735e 1073741824 Jul 08 14:35:29 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0cc0364-d416-406a-b0e9-9824eda3f31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:29 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Volume volume-4c820a4a-2e93-4730-83fd-69c6e1dec646 (4c820a4a-2e93-4730-83fd-69c6e1dec646): created successfully Jul 08 14:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0cc0364-d416-406a-b0e9-9824eda3f31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Flow 'volume_create_manager' (d290fb9a-d45c-4a75-bbfc-b80b28cdcb99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:29 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b076485d-193f-4135-80aa-79aed19bff03 tempest-GroupSnapshotsTest-449637402 None] Created volume successfully. Jul 08 14:35:30 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-84562f93-5bd6-40f1-87fc-7b4f6f942017 tempest-GroupSnapshotsTest-449637402 None] GroupSnapshot 96f5d4a1-7712-4621-9a09-069e7d5b09f9: creating. Jul 08 14:35:30 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-84562f93-5bd6-40f1-87fc-7b4f6f942017 tempest-GroupSnapshotsTest-449637402 None] Group snapshot 96f5d4a1-7712-4621-9a09-069e7d5b09f9: creating. {{(pid=87240) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 14:35:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cd093fdd-d604-46a7-bc7d-c8c5c232cbd7 tempest-VolumesActionsTest-2064437360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-aea1707c-1f3a-4c63-bda6-7cac9eafc0f2" returned: 0 in 1.011s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cd093fdd-d604-46a7-bc7d-c8c5c232cbd7 tempest-VolumesActionsTest-2064437360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-aea1707c-1f3a-4c63-bda6-7cac9eafc0f2 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-84562f93-5bd6-40f1-87fc-7b4f6f942017 tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:30 devstack sudo[95649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-aea1707c-1f3a-4c63-bda6-7cac9eafc0f2 Jul 08 14:35:30 devstack sudo[95649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:30 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-567e10d0-af82-4912-8cb5-1ba8b7a5735e 1073741824" returned: 0 in 1.152s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-567e10d0-af82-4912-8cb5-1ba8b7a5735e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:30 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-567e10d0-af82-4912-8cb5-1ba8b7a5735e Jul 08 14:35:30 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:30 devstack sudo[95649]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cd093fdd-d604-46a7-bc7d-c8c5c232cbd7 tempest-VolumesActionsTest-2064437360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-aea1707c-1f3a-4c63-bda6-7cac9eafc0f2" returned: 0 in 0.754s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:30 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cd093fdd-d604-46a7-bc7d-c8c5c232cbd7 tempest-VolumesActionsTest-2064437360 None] Lock "cinder-quobyte-aea1707c-1f3a-4c63-bda6-7cac9eafc0f2" released by "delete_volume" :: held 1.877s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-cd093fdd-d604-46a7-bc7d-c8c5c232cbd7 tempest-VolumesActionsTest-2064437360 None] Created reservations ['0f9fc436-0af7-44e4-964d-1e73cd6f6bd3', '1972c76a-1a72-47dc-949b-f0b957c47b61', 'ee7c3e92-d0aa-4473-80dc-49126e96f877', '4a92502b-7ea6-45b9-850f-90817fa5dcde'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cd093fdd-d604-46a7-bc7d-c8c5c232cbd7 tempest-VolumesActionsTest-2064437360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cd093fdd-d604-46a7-bc7d-c8c5c232cbd7 tempest-VolumesActionsTest-2064437360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-cd093fdd-d604-46a7-bc7d-c8c5c232cbd7 tempest-VolumesActionsTest-2064437360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-cd093fdd-d604-46a7-bc7d-c8c5c232cbd7 tempest-VolumesActionsTest-2064437360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cd093fdd-d604-46a7-bc7d-c8c5c232cbd7 tempest-VolumesActionsTest-2064437360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cd093fdd-d604-46a7-bc7d-c8c5c232cbd7 tempest-VolumesActionsTest-2064437360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:31 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:35:31 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:31 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-567e10d0-af82-4912-8cb5-1ba8b7a5735e" returned: 0 in 0.842s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.054s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.249s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1146541893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb0eae48-1888-46c9-b3e7-6926dd19c415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d598209329954e98b011f6800096b479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:27Z,use_quota=True,user_id='bd0b924fe29b4cfeae5d00eac2a11317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Creating volume fb0eae48-1888-46c9-b3e7-6926dd19c415 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:35:31 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fb0eae48-1888-46c9-b3e7-6926dd19c415 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e51a53e-2b23-49ed-81b7-648b02890844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-567e10d0-af82-4912-8cb5-1ba8b7a5735e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d8e57c4-5b7d-4542-8fdf-18986b9e6ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:31 devstack sudo[95662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fb0eae48-1888-46c9-b3e7-6926dd19c415 1073741824 Jul 08 14:35:31 devstack sudo[95662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:31 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Volume volume-567e10d0-af82-4912-8cb5-1ba8b7a5735e (567e10d0-af82-4912-8cb5-1ba8b7a5735e): created successfully Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d8e57c4-5b7d-4542-8fdf-18986b9e6ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Flow 'volume_create_manager' (2e5ba29a-e232-4122-afba-7649883e27a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:31 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-65a96d70-3429-4c1d-bd66-d713b53168ac tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Created volume successfully. Jul 08 14:35:32 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cd093fdd-d604-46a7-bc7d-c8c5c232cbd7 tempest-VolumesActionsTest-2064437360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.876s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:32 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-cd093fdd-d604-46a7-bc7d-c8c5c232cbd7 tempest-VolumesActionsTest-2064437360 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:32 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-cd093fdd-d604-46a7-bc7d-c8c5c232cbd7 tempest-VolumesActionsTest-2064437360 None] Deleted volume successfully. Jul 08 14:35:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cd093fdd-d604-46a7-bc7d-c8c5c232cbd7 tempest-VolumesActionsTest-2064437360 None] Lock "cinder-aea1707c-1f3a-4c63-bda6-7cac9eafc0f2-delete_volume" released by "delete_volume" :: held 3.034s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:32 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:35:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Flow 'volume_create_manager' (5af3c2a9-66dc-477a-a7f9-7a4958059284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff45c691-fcff-457d-8791-13fbc71efeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff45c691-fcff-457d-8791-13fbc71efeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-735763828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d062e082db7742238b6f385a58219200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:32Z,use_quota=True,user_id='2696c54e57e34664b020376dc42b27e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918392d4-1e8d-4589-a378-ab1d55f0cb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (918392d4-1e8d-4589-a378-ab1d55f0cb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13723ee8-596b-405e-9732-402aab98a26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13723ee8-596b-405e-9732-402aab98a26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed', 'volume_name': 'volume-dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ed3e09-4cb1-4e9d-a875-22ac336c3d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3ed3e09-4cb1-4e9d-a875-22ac336c3d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2575dcf-e89b-4c99-a887-e67c2378102b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:32 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Volume dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed', 'volume_size': 1} Jul 08 14:35:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:32 devstack sudo[95662]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fb0eae48-1888-46c9-b3e7-6926dd19c415 1073741824" returned: 0 in 1.168s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fb0eae48-1888-46c9-b3e7-6926dd19c415 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:32 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fb0eae48-1888-46c9-b3e7-6926dd19c415 Jul 08 14:35:32 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:33 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fb0eae48-1888-46c9-b3e7-6926dd19c415" returned: 0 in 0.756s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] <== create_volume: return (1979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:35:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.690s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-440584532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ffb4ecf-dc83-4cdf-9785-2558c70e72a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d598209329954e98b011f6800096b479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:28Z,use_quota=True,user_id='bd0b924fe29b4cfeae5d00eac2a11317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:35:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Creating volume 0ffb4ecf-dc83-4cdf-9785-2558c70e72a0 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:35:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:35:33 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:35:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0ffb4ecf-dc83-4cdf-9785-2558c70e72a0 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:33 devstack sudo[95675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0ffb4ecf-dc83-4cdf-9785-2558c70e72a0 1073741824 Jul 08 14:35:33 devstack sudo[95675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d907dcce-7d29-4116-8909-e4184086cabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb0eae48-1888-46c9-b3e7-6926dd19c415', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e46b4c-055b-439a-991a-05b015f41d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:33 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Volume volume-fb0eae48-1888-46c9-b3e7-6926dd19c415 (fb0eae48-1888-46c9-b3e7-6926dd19c415): created successfully Jul 08 14:35:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68e46b4c-055b-439a-991a-05b015f41d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Flow 'volume_create_manager' (c6e3847b-8020-4088-8b9d-bcd95198a0d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:33 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-278a1a8d-002c-4617-a419-4cf9332d21f5 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Created volume successfully. Jul 08 14:35:34 devstack sudo[95675]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0ffb4ecf-dc83-4cdf-9785-2558c70e72a0 1073741824" returned: 0 in 0.993s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0ffb4ecf-dc83-4cdf-9785-2558c70e72a0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:34 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0ffb4ecf-dc83-4cdf-9785-2558c70e72a0 Jul 08 14:35:34 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:35 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0ffb4ecf-dc83-4cdf-9785-2558c70e72a0" returned: 0 in 0.750s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:35:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.796s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.997s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1515043041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e150a4f1-0413-43c4-b7e9-7cb72ace2f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d598209329954e98b011f6800096b479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:28Z,use_quota=True,user_id='bd0b924fe29b4cfeae5d00eac2a11317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Creating volume e150a4f1-0413-43c4-b7e9-7cb72ace2f58 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:35:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:35:35 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:35:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e150a4f1-0413-43c4-b7e9-7cb72ace2f58 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (feb28402-eee1-4b4e-b6fe-5b85a0e3ea90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ffb4ecf-dc83-4cdf-9785-2558c70e72a0', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:35 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e150a4f1-0413-43c4-b7e9-7cb72ace2f58 1073741824 Jul 08 14:35:35 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06367c3f-b9c5-4f26-8e55-8cced9355de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:35 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Volume volume-0ffb4ecf-dc83-4cdf-9785-2558c70e72a0 (0ffb4ecf-dc83-4cdf-9785-2558c70e72a0): created successfully Jul 08 14:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06367c3f-b9c5-4f26-8e55-8cced9355de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Flow 'volume_create_manager' (6a3e3794-fc17-495e-b434-8991629b4267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:35 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-74e5ddca-d51d-4d76-8483-a9cc17d859fb tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Created volume successfully. Jul 08 14:35:36 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e150a4f1-0413-43c4-b7e9-7cb72ace2f58 1073741824" returned: 0 in 0.999s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e150a4f1-0413-43c4-b7e9-7cb72ace2f58 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:36 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e150a4f1-0413-43c4-b7e9-7cb72ace2f58 Jul 08 14:35:36 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:37 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e150a4f1-0413-43c4-b7e9-7cb72ace2f58" returned: 0 in 0.752s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:35:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.295s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2039638198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bca27373-601b-4d9d-bd66-01a2fbb0fdcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d598209329954e98b011f6800096b479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:29Z,use_quota=True,user_id='bd0b924fe29b4cfeae5d00eac2a11317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:35:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Creating volume bca27373-601b-4d9d-bd66-01a2fbb0fdcb {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:35:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:35:37 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:35:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bca27373-601b-4d9d-bd66-01a2fbb0fdcb 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9683d675-dce9-4a36-87df-6d925c9ebf53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e150a4f1-0413-43c4-b7e9-7cb72ace2f58', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66141f0-669c-46ea-999d-b0629bb5dd52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:37 devstack sudo[95693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bca27373-601b-4d9d-bd66-01a2fbb0fdcb 1073741824 Jul 08 14:35:37 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:37 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Volume volume-e150a4f1-0413-43c4-b7e9-7cb72ace2f58 (e150a4f1-0413-43c4-b7e9-7cb72ace2f58): created successfully Jul 08 14:35:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c66141f0-669c-46ea-999d-b0629bb5dd52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Flow 'volume_create_manager' (b491a4d2-509d-4165-a0d3-0346b45e1a69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:37 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4b939590-686d-457c-8d8f-d139b4caedc8 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Created volume successfully. Jul 08 14:35:38 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bca27373-601b-4d9d-bd66-01a2fbb0fdcb 1073741824" returned: 0 in 1.170s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bca27373-601b-4d9d-bd66-01a2fbb0fdcb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:38 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bca27373-601b-4d9d-bd66-01a2fbb0fdcb Jul 08 14:35:38 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:39 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bca27373-601b-4d9d-bd66-01a2fbb0fdcb" returned: 0 in 0.907s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] <== create_volume: return (2137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:35:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.144s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-84562f93-5bd6-40f1-87fc-7b4f6f942017 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.160s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dbc3c43-79a6-4fdc-ba98-78ccfcd1eb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bca27373-601b-4d9d-bd66-01a2fbb0fdcb', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a67a4e-bcd4-4a25-a588-207b24eec3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-84562f93-5bd6-40f1-87fc-7b4f6f942017 tempest-GroupSnapshotsTest-449637402 None] Creating offline snapshot ce507f7b-15c3-4efa-a184-7b534a97b361 of volume 4c820a4a-2e93-4730-83fd-69c6e1dec646 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:35:39 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Volume volume-bca27373-601b-4d9d-bd66-01a2fbb0fdcb (bca27373-601b-4d9d-bd66-01a2fbb0fdcb): created successfully Jul 08 14:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a67a4e-bcd4-4a25-a588-207b24eec3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Flow 'volume_create_manager' (49d6398a-63e2-4ad0-a9cf-62fd278752a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:39 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa06ab0-4bb2-4bba-b7bc-7d47852f86b5]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-84562f93-5bd6-40f1-87fc-7b4f6f942017 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:39 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-54683bec-dd67-4d99-b4c7-114d0cf1495f tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Created volume successfully. Jul 08 14:35:39 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646 Jul 08 14:35:39 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9ce23517-25e9-4f70-bc30-4d2bca7fda4c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "cinder-bca27373-601b-4d9d-bd66-01a2fbb0fdcb-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9ce23517-25e9-4f70-bc30-4d2bca7fda4c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-bca27373-601b-4d9d-bd66-01a2fbb0fdcb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9ce23517-25e9-4f70-bc30-4d2bca7fda4c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "cinder-quobyte-bca27373-601b-4d9d-bd66-01a2fbb0fdcb" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9ce23517-25e9-4f70-bc30-4d2bca7fda4c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-quobyte-bca27373-601b-4d9d-bd66-01a2fbb0fdcb" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:40 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3fd4014-02f3-421f-a24b-3d08241484b1]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9ce23517-25e9-4f70-bc30-4d2bca7fda4c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bca27373-601b-4d9d-bd66-01a2fbb0fdcb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:40 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bca27373-601b-4d9d-bd66-01a2fbb0fdcb Jul 08 14:35:40 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:40 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-84562f93-5bd6-40f1-87fc-7b4f6f942017 tempest-GroupSnapshotsTest-449637402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646" returned: 0 in 1.013s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-84562f93-5bd6-40f1-87fc-7b4f6f942017 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.ce507f7b-15c3-4efa-a184-7b534a97b361 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:40 devstack sudo[95735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.ce507f7b-15c3-4efa-a184-7b534a97b361 1G Jul 08 14:35:40 devstack sudo[95735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:41 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9ce23517-25e9-4f70-bc30-4d2bca7fda4c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bca27373-601b-4d9d-bd66-01a2fbb0fdcb" returned: 0 in 0.918s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9ce23517-25e9-4f70-bc30-4d2bca7fda4c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bca27373-601b-4d9d-bd66-01a2fbb0fdcb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:41 devstack sudo[95767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bca27373-601b-4d9d-bd66-01a2fbb0fdcb Jul 08 14:35:41 devstack sudo[95767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:41 devstack sudo[95735]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-84562f93-5bd6-40f1-87fc-7b4f6f942017 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.ce507f7b-15c3-4efa-a184-7b534a97b361 1G" returned: 0 in 0.937s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-84562f93-5bd6-40f1-87fc-7b4f6f942017 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c820a4a-2e93-4730-83fd-69c6e1dec646 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.ce507f7b-15c3-4efa-a184-7b534a97b361 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:41 devstack sudo[95772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c820a4a-2e93-4730-83fd-69c6e1dec646 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.ce507f7b-15c3-4efa-a184-7b534a97b361 Jul 08 14:35:41 devstack sudo[95772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:41 devstack sudo[95767]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9ce23517-25e9-4f70-bc30-4d2bca7fda4c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bca27373-601b-4d9d-bd66-01a2fbb0fdcb" returned: 0 in 0.801s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9ce23517-25e9-4f70-bc30-4d2bca7fda4c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-quobyte-bca27373-601b-4d9d-bd66-01a2fbb0fdcb" released by "delete_volume" :: held 1.773s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:41 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-9ce23517-25e9-4f70-bc30-4d2bca7fda4c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Created reservations ['95fa3368-97ba-4883-b689-8a5cae6f4713', 'cc8ea120-ecc7-4b9e-b8a4-a08643585b8f', '1b96f641-836e-460d-8769-9fb92c9b1104', '82ab7ccd-8b05-47bb-8ec2-a581a75d9caf'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9ce23517-25e9-4f70-bc30-4d2bca7fda4c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9ce23517-25e9-4f70-bc30-4d2bca7fda4c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9ce23517-25e9-4f70-bc30-4d2bca7fda4c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9ce23517-25e9-4f70-bc30-4d2bca7fda4c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9ce23517-25e9-4f70-bc30-4d2bca7fda4c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9ce23517-25e9-4f70-bc30-4d2bca7fda4c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:42 devstack sudo[95775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:35:42 devstack sudo[95775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5db93b78-adf3-4158-817c-68dd88a7343c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "cinder-e150a4f1-0413-43c4-b7e9-7cb72ace2f58-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5db93b78-adf3-4158-817c-68dd88a7343c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-e150a4f1-0413-43c4-b7e9-7cb72ace2f58-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5db93b78-adf3-4158-817c-68dd88a7343c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "cinder-quobyte-e150a4f1-0413-43c4-b7e9-7cb72ace2f58" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5db93b78-adf3-4158-817c-68dd88a7343c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-quobyte-e150a4f1-0413-43c4-b7e9-7cb72ace2f58" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:42 devstack sudo[95772]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-84562f93-5bd6-40f1-87fc-7b4f6f942017 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c820a4a-2e93-4730-83fd-69c6e1dec646 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.ce507f7b-15c3-4efa-a184-7b534a97b361" returned: 0 in 0.947s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:42 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-84562f93-5bd6-40f1-87fc-7b4f6f942017 tempest-GroupSnapshotsTest-449637402 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.ce507f7b-15c3-4efa-a184-7b534a97b361 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:35:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-84562f93-5bd6-40f1-87fc-7b4f6f942017 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.ce507f7b-15c3-4efa-a184-7b534a97b361 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:42 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9cad88-4221-4b45-94c1-f4f7e0ecbae3]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5db93b78-adf3-4158-817c-68dd88a7343c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e150a4f1-0413-43c4-b7e9-7cb72ace2f58 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:42 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.ce507f7b-15c3-4efa-a184-7b534a97b361 Jul 08 14:35:42 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:42 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e150a4f1-0413-43c4-b7e9-7cb72ace2f58 Jul 08 14:35:42 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:42 devstack sudo[95775]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9ce23517-25e9-4f70-bc30-4d2bca7fda4c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.864s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:42 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-9ce23517-25e9-4f70-bc30-4d2bca7fda4c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9ce23517-25e9-4f70-bc30-4d2bca7fda4c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Deleted volume successfully. Jul 08 14:35:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9ce23517-25e9-4f70-bc30-4d2bca7fda4c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-bca27373-601b-4d9d-bd66-01a2fbb0fdcb-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:43 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5db93b78-adf3-4158-817c-68dd88a7343c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e150a4f1-0413-43c4-b7e9-7cb72ace2f58" returned: 0 in 0.897s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5db93b78-adf3-4158-817c-68dd88a7343c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e150a4f1-0413-43c4-b7e9-7cb72ace2f58 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:43 devstack sudo[95795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e150a4f1-0413-43c4-b7e9-7cb72ace2f58 Jul 08 14:35:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-84562f93-5bd6-40f1-87fc-7b4f6f942017 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.ce507f7b-15c3-4efa-a184-7b534a97b361" returned: 0 in 0.946s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:43 devstack sudo[95795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:43 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-84562f93-5bd6-40f1-87fc-7b4f6f942017 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:43 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.info Jul 08 14:35:43 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:44 devstack sudo[95795]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5db93b78-adf3-4158-817c-68dd88a7343c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e150a4f1-0413-43c4-b7e9-7cb72ace2f58" returned: 0 in 1.099s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5db93b78-adf3-4158-817c-68dd88a7343c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-quobyte-e150a4f1-0413-43c4-b7e9-7cb72ace2f58" released by "delete_volume" :: held 2.055s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:44 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-5db93b78-adf3-4158-817c-68dd88a7343c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Created reservations ['0ceb178d-ba82-4845-9c6d-b4f532234925', 'bdfec73a-6ddc-4a1f-8b3e-780b366416f9', 'af3114fb-c8f5-4788-8bfa-86d3a50653bc', 'db27c86a-a3c0-4989-b334-19e3c2341597'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5db93b78-adf3-4158-817c-68dd88a7343c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5db93b78-adf3-4158-817c-68dd88a7343c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5db93b78-adf3-4158-817c-68dd88a7343c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5db93b78-adf3-4158-817c-68dd88a7343c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5db93b78-adf3-4158-817c-68dd88a7343c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5db93b78-adf3-4158-817c-68dd88a7343c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:44 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-84562f93-5bd6-40f1-87fc-7b4f6f942017 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.info" returned: 0 in 1.306s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:44 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-84562f93-5bd6-40f1-87fc-7b4f6f942017 tempest-GroupSnapshotsTest-449637402 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:35:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-84562f93-5bd6-40f1-87fc-7b4f6f942017 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:44 devstack sudo[95848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:35:44 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:44 devstack sudo[95849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.info Jul 08 14:35:44 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3d7f113c-6f31-4206-980e-8ff14c05db5c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "cinder-0ffb4ecf-dc83-4cdf-9785-2558c70e72a0-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3d7f113c-6f31-4206-980e-8ff14c05db5c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-0ffb4ecf-dc83-4cdf-9785-2558c70e72a0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3d7f113c-6f31-4206-980e-8ff14c05db5c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "cinder-quobyte-0ffb4ecf-dc83-4cdf-9785-2558c70e72a0" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3d7f113c-6f31-4206-980e-8ff14c05db5c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-quobyte-0ffb4ecf-dc83-4cdf-9785-2558c70e72a0" acquired by "delete_volume" :: waited 0.036s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e0f948-23be-4d25-a961-d11316d83807]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3d7f113c-6f31-4206-980e-8ff14c05db5c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0ffb4ecf-dc83-4cdf-9785-2558c70e72a0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:45 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0ffb4ecf-dc83-4cdf-9785-2558c70e72a0 Jul 08 14:35:45 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:45 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-84562f93-5bd6-40f1-87fc-7b4f6f942017 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.info" returned: 0 in 0.902s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-84562f93-5bd6-40f1-87fc-7b4f6f942017 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.243s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.401s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-735763828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d062e082db7742238b6f385a58219200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:32Z,use_quota=True,user_id='2696c54e57e34664b020376dc42b27e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:35:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Creating volume dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:35:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:35:45 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:35:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:45 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed 1073741824 Jul 08 14:35:45 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:45 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5db93b78-adf3-4158-817c-68dd88a7343c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.042s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:45 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-5db93b78-adf3-4158-817c-68dd88a7343c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:45 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5db93b78-adf3-4158-817c-68dd88a7343c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Deleted volume successfully. Jul 08 14:35:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5db93b78-adf3-4158-817c-68dd88a7343c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-e150a4f1-0413-43c4-b7e9-7cb72ace2f58-delete_volume" released by "delete_volume" :: held 3.470s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:45 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-84562f93-5bd6-40f1-87fc-7b4f6f942017 tempest-GroupSnapshotsTest-449637402 None] group_snapshot 96f5d4a1-7712-4621-9a09-069e7d5b09f9: created successfully Jul 08 14:35:46 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3d7f113c-6f31-4206-980e-8ff14c05db5c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0ffb4ecf-dc83-4cdf-9785-2558c70e72a0" returned: 0 in 1.136s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3d7f113c-6f31-4206-980e-8ff14c05db5c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0ffb4ecf-dc83-4cdf-9785-2558c70e72a0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:46 devstack sudo[95881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0ffb4ecf-dc83-4cdf-9785-2558c70e72a0 Jul 08 14:35:46 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-79f385b2-9612-46a5-ab86-45053da41dbd tempest-GroupSnapshotsTest-449637402 None] group_snapshot 96f5d4a1-7712-4621-9a09-069e7d5b09f9: deleting Jul 08 14:35:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-79f385b2-9612-46a5-ab86-45053da41dbd tempest-GroupSnapshotsTest-449637402 None] group_snapshot 96f5d4a1-7712-4621-9a09-069e7d5b09f9: deleting {{(pid=87240) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 14:35:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-79f385b2-9612-46a5-ab86-45053da41dbd tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "cinder-quobyte-4c820a4a-2e93-4730-83fd-69c6e1dec646" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-79f385b2-9612-46a5-ab86-45053da41dbd tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-4c820a4a-2e93-4730-83fd-69c6e1dec646" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-79f385b2-9612-46a5-ab86-45053da41dbd tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "cinder-quobyte-ce507f7b-15c3-4efa-a184-7b534a97b361" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-79f385b2-9612-46a5-ab86-45053da41dbd tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-ce507f7b-15c3-4efa-a184-7b534a97b361" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-79f385b2-9612-46a5-ab86-45053da41dbd tempest-GroupSnapshotsTest-449637402 None] Deleting offline snapshot ce507f7b-15c3-4efa-a184-7b534a97b361 of volume 4c820a4a-2e93-4730-83fd-69c6e1dec646 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:35:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-79f385b2-9612-46a5-ab86-45053da41dbd tempest-GroupSnapshotsTest-449637402 None] snapshot_file for this snap is: volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.ce507f7b-15c3-4efa-a184-7b534a97b361 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:35:46 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[09eaa06b-5782-48a0-b792-0f4ebdc70fc8]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-79f385b2-9612-46a5-ab86-45053da41dbd tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.ce507f7b-15c3-4efa-a184-7b534a97b361 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:46 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.ce507f7b-15c3-4efa-a184-7b534a97b361 Jul 08 14:35:46 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:47 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed 1073741824" returned: 0 in 1.587s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:47 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3d7f113c-6f31-4206-980e-8ff14c05db5c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0ffb4ecf-dc83-4cdf-9785-2558c70e72a0" returned: 0 in 1.278s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:47 devstack sudo[95891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed Jul 08 14:35:47 devstack sudo[95891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3d7f113c-6f31-4206-980e-8ff14c05db5c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-quobyte-0ffb4ecf-dc83-4cdf-9785-2558c70e72a0" released by "delete_volume" :: held 2.492s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:47 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-3d7f113c-6f31-4206-980e-8ff14c05db5c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Created reservations ['054e2b19-7016-4d6d-ac38-b28b8ae2e012', '57e340b6-835e-4e61-8d82-7772dd21c19e', 'bfa3c8d6-eac4-4169-8105-7f9d0196c3d6', '916fc5a9-339e-471a-b079-5e87456a2702'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3d7f113c-6f31-4206-980e-8ff14c05db5c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3d7f113c-6f31-4206-980e-8ff14c05db5c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3d7f113c-6f31-4206-980e-8ff14c05db5c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3d7f113c-6f31-4206-980e-8ff14c05db5c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3d7f113c-6f31-4206-980e-8ff14c05db5c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3d7f113c-6f31-4206-980e-8ff14c05db5c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:47 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:35:47 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:48 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-79f385b2-9612-46a5-ab86-45053da41dbd tempest-GroupSnapshotsTest-449637402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.ce507f7b-15c3-4efa-a184-7b534a97b361" returned: 0 in 1.514s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-79f385b2-9612-46a5-ab86-45053da41dbd tempest-GroupSnapshotsTest-449637402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c820a4a-2e93-4730-83fd-69c6e1dec646(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:35:48 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4f1574-614c-4191-a38d-ecf18cf9dc37]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-79f385b2-9612-46a5-ab86-45053da41dbd tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:48 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646 Jul 08 14:35:48 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e7a92022-edd2-4b69-b60c-9991e985d8e9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "cinder-fb0eae48-1888-46c9-b3e7-6926dd19c415-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e7a92022-edd2-4b69-b60c-9991e985d8e9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-fb0eae48-1888-46c9-b3e7-6926dd19c415-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:48 devstack sudo[95891]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed" returned: 0 in 1.358s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] <== create_volume: return (3041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:35:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.050s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2575dcf-e89b-4c99-a887-e67c2378102b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17bce82-51ac-4e20-b16b-f13dde035df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e7a92022-edd2-4b69-b60c-9991e985d8e9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "cinder-quobyte-fb0eae48-1888-46c9-b3e7-6926dd19c415" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:48 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Volume volume-dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed (dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed): created successfully Jul 08 14:35:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17bce82-51ac-4e20-b16b-f13dde035df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Flow 'volume_create_manager' (5af3c2a9-66dc-477a-a7f9-7a4958059284) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e7a92022-edd2-4b69-b60c-9991e985d8e9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-quobyte-fb0eae48-1888-46c9-b3e7-6926dd19c415" acquired by "delete_volume" :: waited 0.065s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:48 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-933b06fa-b5a7-4ff7-ab74-1541dc978c9e tempest-VolumesActionsTest-1035642129 None] Created volume successfully. Jul 08 14:35:48 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4b7c1b-c01c-488a-bd86-b686dc904fcc]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7a92022-edd2-4b69-b60c-9991e985d8e9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fb0eae48-1888-46c9-b3e7-6926dd19c415 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:49 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fb0eae48-1888-46c9-b3e7-6926dd19c415 Jul 08 14:35:49 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:49 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3d7f113c-6f31-4206-980e-8ff14c05db5c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.577s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:49 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-3d7f113c-6f31-4206-980e-8ff14c05db5c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:49 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3d7f113c-6f31-4206-980e-8ff14c05db5c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Deleted volume successfully. Jul 08 14:35:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3d7f113c-6f31-4206-980e-8ff14c05db5c tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-0ffb4ecf-dc83-4cdf-9785-2558c70e72a0-delete_volume" released by "delete_volume" :: held 4.436s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:49 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-79f385b2-9612-46a5-ab86-45053da41dbd tempest-GroupSnapshotsTest-449637402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646" returned: 0 in 1.569s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-79f385b2-9612-46a5-ab86-45053da41dbd tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.ce507f7b-15c3-4efa-a184-7b534a97b361 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:49 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.ce507f7b-15c3-4efa-a184-7b534a97b361 Jul 08 14:35:49 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3c2a6e6c-48ee-4486-bd06-eb3ad9509a1d tempest-VolumesActionsTest-2064437360 None] Acquiring lock "cinder-dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3c2a6e6c-48ee-4486-bd06-eb3ad9509a1d tempest-VolumesActionsTest-2064437360 None] Lock "cinder-dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3c2a6e6c-48ee-4486-bd06-eb3ad9509a1d tempest-VolumesActionsTest-2064437360 None] Acquiring lock "cinder-quobyte-dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3c2a6e6c-48ee-4486-bd06-eb3ad9509a1d tempest-VolumesActionsTest-2064437360 None] Lock "cinder-quobyte-dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed" acquired by "delete_volume" :: waited 0.036s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:50 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa576bc-cce8-4795-8f85-cd1920e2a9f3]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c2a6e6c-48ee-4486-bd06-eb3ad9509a1d tempest-VolumesActionsTest-2064437360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:50 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed Jul 08 14:35:50 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:50 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7a92022-edd2-4b69-b60c-9991e985d8e9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fb0eae48-1888-46c9-b3e7-6926dd19c415" returned: 0 in 1.806s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7a92022-edd2-4b69-b60c-9991e985d8e9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fb0eae48-1888-46c9-b3e7-6926dd19c415 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:50 devstack sudo[95925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fb0eae48-1888-46c9-b3e7-6926dd19c415 Jul 08 14:35:50 devstack sudo[95925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:51 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-79f385b2-9612-46a5-ab86-45053da41dbd tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.ce507f7b-15c3-4efa-a184-7b534a97b361" returned: 0 in 1.535s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-79f385b2-9612-46a5-ab86-45053da41dbd tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.ce507f7b-15c3-4efa-a184-7b534a97b361 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:51 devstack sudo[95938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.ce507f7b-15c3-4efa-a184-7b534a97b361 Jul 08 14:35:51 devstack sudo[95938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:51 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c2a6e6c-48ee-4486-bd06-eb3ad9509a1d tempest-VolumesActionsTest-2064437360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed" returned: 0 in 1.486s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c2a6e6c-48ee-4486-bd06-eb3ad9509a1d tempest-VolumesActionsTest-2064437360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:51 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed Jul 08 14:35:51 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:52 devstack sudo[95925]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7a92022-edd2-4b69-b60c-9991e985d8e9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fb0eae48-1888-46c9-b3e7-6926dd19c415" returned: 0 in 1.442s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e7a92022-edd2-4b69-b60c-9991e985d8e9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-quobyte-fb0eae48-1888-46c9-b3e7-6926dd19c415" released by "delete_volume" :: held 3.331s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:52 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-e7a92022-edd2-4b69-b60c-9991e985d8e9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Created reservations ['9daf5bb9-0155-4321-bd7b-4d68dbc4d472', '93d384de-4b40-44c7-b8cf-8f348ae349a1', 'b087f85b-c96d-4410-ad1e-92a246bef77e', '5c98fe02-6040-4f88-82a6-9326252bd4d1'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:52 devstack sudo[95938]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-79f385b2-9612-46a5-ab86-45053da41dbd tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646.ce507f7b-15c3-4efa-a184-7b534a97b361" returned: 0 in 1.079s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-79f385b2-9612-46a5-ab86-45053da41dbd tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-ce507f7b-15c3-4efa-a184-7b534a97b361" released by "_delete_snapshot" :: held 5.863s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-79f385b2-9612-46a5-ab86-45053da41dbd tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-4c820a4a-2e93-4730-83fd-69c6e1dec646" released by "delete_snapshot" :: held 5.911s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e7a92022-edd2-4b69-b60c-9991e985d8e9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e7a92022-edd2-4b69-b60c-9991e985d8e9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e7a92022-edd2-4b69-b60c-9991e985d8e9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e7a92022-edd2-4b69-b60c-9991e985d8e9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e7a92022-edd2-4b69-b60c-9991e985d8e9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7a92022-edd2-4b69-b60c-9991e985d8e9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:52 devstack cinder-volume[87240]: WARNING cinder.quota [None req-79f385b2-9612-46a5-ab86-45053da41dbd tempest-GroupSnapshotsTest-449637402 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-683051184 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-683051184, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:35:52 devstack cinder-volume[87240]: WARNING cinder.quota [None req-79f385b2-9612-46a5-ab86-45053da41dbd tempest-GroupSnapshotsTest-449637402 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-683051184 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-683051184, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:35:52 devstack sudo[95950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:35:52 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:52 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-79f385b2-9612-46a5-ab86-45053da41dbd tempest-GroupSnapshotsTest-449637402 None] Created reservations ['fe9a9fd5-4f52-4759-8ec6-ff3c84443e9b', '6a1e1ebc-f06c-408f-b895-cd713205a466', '9a3bd572-6bfc-4739-8d76-c25b26176fa3', '4e885978-7101-4274-94c8-8aecfd293d66'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:52 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-79f385b2-9612-46a5-ab86-45053da41dbd tempest-GroupSnapshotsTest-449637402 None] group_snapshot 96f5d4a1-7712-4621-9a09-069e7d5b09f9: deleted successfully Jul 08 14:35:53 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c2a6e6c-48ee-4486-bd06-eb3ad9509a1d tempest-VolumesActionsTest-2064437360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed" returned: 0 in 1.202s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3c2a6e6c-48ee-4486-bd06-eb3ad9509a1d tempest-VolumesActionsTest-2064437360 None] Lock "cinder-quobyte-dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed" released by "delete_volume" :: held 2.753s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:53 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-3c2a6e6c-48ee-4486-bd06-eb3ad9509a1d tempest-VolumesActionsTest-2064437360 None] Created reservations ['ec779e5c-a923-467e-af37-18ced1b38402', '6cd35a31-cddc-46b4-a206-025a391f41a6', '00fa7698-bceb-4550-9224-b60e23f25df6', '66b3ca30-c196-4445-90fc-5ab1d4f991bb'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e17b5169-34d0-4956-bffa-01ad22fe2688 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "cinder-567e10d0-af82-4912-8cb5-1ba8b7a5735e-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e17b5169-34d0-4956-bffa-01ad22fe2688 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-567e10d0-af82-4912-8cb5-1ba8b7a5735e-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3c2a6e6c-48ee-4486-bd06-eb3ad9509a1d tempest-VolumesActionsTest-2064437360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3c2a6e6c-48ee-4486-bd06-eb3ad9509a1d tempest-VolumesActionsTest-2064437360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3c2a6e6c-48ee-4486-bd06-eb3ad9509a1d tempest-VolumesActionsTest-2064437360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3c2a6e6c-48ee-4486-bd06-eb3ad9509a1d tempest-VolumesActionsTest-2064437360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3c2a6e6c-48ee-4486-bd06-eb3ad9509a1d tempest-VolumesActionsTest-2064437360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c2a6e6c-48ee-4486-bd06-eb3ad9509a1d tempest-VolumesActionsTest-2064437360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e17b5169-34d0-4956-bffa-01ad22fe2688 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "cinder-quobyte-567e10d0-af82-4912-8cb5-1ba8b7a5735e" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e17b5169-34d0-4956-bffa-01ad22fe2688 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-quobyte-567e10d0-af82-4912-8cb5-1ba8b7a5735e" acquired by "delete_volume" :: waited 0.036s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:53 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:53 devstack sudo[95954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:35:53 devstack sudo[95954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7a92022-edd2-4b69-b60c-9991e985d8e9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.199s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:53 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-e7a92022-edd2-4b69-b60c-9991e985d8e9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:53 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e7a92022-edd2-4b69-b60c-9991e985d8e9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Deleted volume successfully. Jul 08 14:35:53 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ab082b-6ba7-4eb7-8d39-d54e44df5bda]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e17b5169-34d0-4956-bffa-01ad22fe2688 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-567e10d0-af82-4912-8cb5-1ba8b7a5735e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e7a92022-edd2-4b69-b60c-9991e985d8e9 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-fb0eae48-1888-46c9-b3e7-6926dd19c415-delete_volume" released by "delete_volume" :: held 5.148s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:53 devstack sudo[95956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-567e10d0-af82-4912-8cb5-1ba8b7a5735e Jul 08 14:35:53 devstack sudo[95956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-732b179b-e687-4ede-b8c2-f5079e429c44 tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "cinder-quobyte-4c820a4a-2e93-4730-83fd-69c6e1dec646" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-732b179b-e687-4ede-b8c2-f5079e429c44 tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-4c820a4a-2e93-4730-83fd-69c6e1dec646" acquired by "delete_volume" :: waited 0.037s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:54 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b2168d-3e37-4588-981c-5f24643badaa]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-732b179b-e687-4ede-b8c2-f5079e429c44 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:54 devstack sudo[95958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646 Jul 08 14:35:54 devstack sudo[95958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:54 devstack sudo[95954]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c2a6e6c-48ee-4486-bd06-eb3ad9509a1d tempest-VolumesActionsTest-2064437360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.223s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:54 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-3c2a6e6c-48ee-4486-bd06-eb3ad9509a1d tempest-VolumesActionsTest-2064437360 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:54 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3c2a6e6c-48ee-4486-bd06-eb3ad9509a1d tempest-VolumesActionsTest-2064437360 None] Deleted volume successfully. Jul 08 14:35:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3c2a6e6c-48ee-4486-bd06-eb3ad9509a1d tempest-VolumesActionsTest-2064437360 None] Lock "cinder-dfdbcfc8-d7cb-45d9-92ed-58a71ab619ed-delete_volume" released by "delete_volume" :: held 4.570s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Flow 'volume_create_manager' (92305a8a-f461-476b-b21f-eaded65c29d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7454c42e-64a9-4517-a85e-58716eca72df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7454c42e-64a9-4517-a85e-58716eca72df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-41347921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d8f03ae-ab98-4923-8564-bbe7f142e1c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d062e082db7742238b6f385a58219200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:55Z,use_quota=True,user_id='2696c54e57e34664b020376dc42b27e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd6ee5b-0c4c-4a69-9a05-bc5ba8eb98d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd6ee5b-0c4c-4a69-9a05-bc5ba8eb98d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f418e45-a300-47cc-9e80-2e52b7d91872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f418e45-a300-47cc-9e80-2e52b7d91872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d8f03ae-ab98-4923-8564-bbe7f142e1c1', 'volume_name': 'volume-9d8f03ae-ab98-4923-8564-bbe7f142e1c1', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6b44e4-d548-4f1f-aa52-7811f7f674fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a6b44e4-d548-4f1f-aa52-7811f7f674fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abb0691-c68e-43cd-9b29-066083471ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:55 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Volume 9d8f03ae-ab98-4923-8564-bbe7f142e1c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d8f03ae-ab98-4923-8564-bbe7f142e1c1', 'volume_size': 1} Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-41347921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d8f03ae-ab98-4923-8564-bbe7f142e1c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d062e082db7742238b6f385a58219200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:35:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:35:55Z,use_quota=True,user_id='2696c54e57e34664b020376dc42b27e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Creating volume 9d8f03ae-ab98-4923-8564-bbe7f142e1c1 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:35:55 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9d8f03ae-ab98-4923-8564-bbe7f142e1c1 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:55 devstack sudo[95958]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-732b179b-e687-4ede-b8c2-f5079e429c44 tempest-GroupSnapshotsTest-449637402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646" returned: 0 in 1.212s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-732b179b-e687-4ede-b8c2-f5079e429c44 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:55 devstack sudo[95956]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e17b5169-34d0-4956-bffa-01ad22fe2688 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-567e10d0-af82-4912-8cb5-1ba8b7a5735e" returned: 0 in 1.603s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e17b5169-34d0-4956-bffa-01ad22fe2688 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-567e10d0-af82-4912-8cb5-1ba8b7a5735e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:55 devstack sudo[95967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9d8f03ae-ab98-4923-8564-bbe7f142e1c1 1073741824 Jul 08 14:35:55 devstack sudo[95967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:55 devstack sudo[95968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646 Jul 08 14:35:55 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-567e10d0-af82-4912-8cb5-1ba8b7a5735e Jul 08 14:35:55 devstack sudo[95968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:55 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:56 devstack sudo[95968]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-732b179b-e687-4ede-b8c2-f5079e429c44 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4c820a4a-2e93-4730-83fd-69c6e1dec646" returned: 0 in 0.891s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-732b179b-e687-4ede-b8c2-f5079e429c44 tempest-GroupSnapshotsTest-449637402 None] Lock "cinder-quobyte-4c820a4a-2e93-4730-83fd-69c6e1dec646" released by "delete_volume" :: held 2.222s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:56 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e17b5169-34d0-4956-bffa-01ad22fe2688 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-567e10d0-af82-4912-8cb5-1ba8b7a5735e" returned: 0 in 0.941s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e17b5169-34d0-4956-bffa-01ad22fe2688 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-quobyte-567e10d0-af82-4912-8cb5-1ba8b7a5735e" released by "delete_volume" :: held 2.632s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:56 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-732b179b-e687-4ede-b8c2-f5079e429c44 tempest-GroupSnapshotsTest-449637402 None] Created reservations ['275f6102-6eda-4399-875d-e3e48f86839f'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:56 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-e17b5169-34d0-4956-bffa-01ad22fe2688 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Created reservations ['946639e2-a9d8-4469-8fa8-5a7391ec0786', '4830c88b-4265-4220-8792-8f391e15dbb0', 'b9f4c1c2-ac2f-4858-a572-45af165075d9', '7dd5f69a-75ee-4ef6-926d-b9b9688c45ad'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:56 devstack cinder-volume[87240]: WARNING cinder.quota [None req-732b179b-e687-4ede-b8c2-f5079e429c44 tempest-GroupSnapshotsTest-449637402 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-683051184 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-683051184, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:35:56 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-732b179b-e687-4ede-b8c2-f5079e429c44 tempest-GroupSnapshotsTest-449637402 None] Created reservations ['ef3fefe9-18a3-42e2-9b02-e4746a57a5d4', '7635a399-cffb-437c-b7e6-4a7788dfddd4', '0b0faef1-67ed-41a5-a366-579a995d1462', '0e1c8841-d208-4cff-af61-a1122da96dff'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e17b5169-34d0-4956-bffa-01ad22fe2688 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e17b5169-34d0-4956-bffa-01ad22fe2688 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e17b5169-34d0-4956-bffa-01ad22fe2688 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e17b5169-34d0-4956-bffa-01ad22fe2688 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e17b5169-34d0-4956-bffa-01ad22fe2688 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e17b5169-34d0-4956-bffa-01ad22fe2688 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:56 devstack sudo[95979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:35:56 devstack sudo[95979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:56 devstack sudo[95967]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9d8f03ae-ab98-4923-8564-bbe7f142e1c1 1073741824" returned: 0 in 1.335s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-732b179b-e687-4ede-b8c2-f5079e429c44 tempest-GroupSnapshotsTest-449637402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-732b179b-e687-4ede-b8c2-f5079e429c44 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-732b179b-e687-4ede-b8c2-f5079e429c44 tempest-GroupSnapshotsTest-449637402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-732b179b-e687-4ede-b8c2-f5079e429c44 tempest-GroupSnapshotsTest-449637402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-732b179b-e687-4ede-b8c2-f5079e429c44 tempest-GroupSnapshotsTest-449637402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-732b179b-e687-4ede-b8c2-f5079e429c44 tempest-GroupSnapshotsTest-449637402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9d8f03ae-ab98-4923-8564-bbe7f142e1c1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:56 devstack sudo[95981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:35:56 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:56 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9d8f03ae-ab98-4923-8564-bbe7f142e1c1 Jul 08 14:35:56 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7e0da2a8-bead-4cc2-a022-070e47771cf3 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "cinder-feae6f19-509a-435e-b776-6dd7e1a29a6f-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7e0da2a8-bead-4cc2-a022-070e47771cf3 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-feae6f19-509a-435e-b776-6dd7e1a29a6f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7e0da2a8-bead-4cc2-a022-070e47771cf3 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "cinder-quobyte-feae6f19-509a-435e-b776-6dd7e1a29a6f" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7e0da2a8-bead-4cc2-a022-070e47771cf3 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-quobyte-feae6f19-509a-435e-b776-6dd7e1a29a6f" acquired by "delete_volume" :: waited 0.034s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:57 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb18db74-b685-443a-ae73-e2cd7539c6a5]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e0da2a8-bead-4cc2-a022-070e47771cf3 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-feae6f19-509a-435e-b776-6dd7e1a29a6f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:57 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-feae6f19-509a-435e-b776-6dd7e1a29a6f Jul 08 14:35:57 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:57 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-732b179b-e687-4ede-b8c2-f5079e429c44 tempest-GroupSnapshotsTest-449637402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.888s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:57 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-732b179b-e687-4ede-b8c2-f5079e429c44 tempest-GroupSnapshotsTest-449637402 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:57 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-732b179b-e687-4ede-b8c2-f5079e429c44 tempest-GroupSnapshotsTest-449637402 None] Delete group completed successfully. Jul 08 14:35:57 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9d8f03ae-ab98-4923-8564-bbe7f142e1c1" returned: 0 in 0.917s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] <== create_volume: return (2324ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:35:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.328s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7abb0691-c68e-43cd-9b29-066083471ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d8f03ae-ab98-4923-8564-bbe7f142e1c1', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd06727-11a9-4114-8e1f-e2b7eb3121ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:35:57 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Volume volume-9d8f03ae-ab98-4923-8564-bbe7f142e1c1 (9d8f03ae-ab98-4923-8564-bbe7f142e1c1): created successfully Jul 08 14:35:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fd06727-11a9-4114-8e1f-e2b7eb3121ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:35:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Flow 'volume_create_manager' (92305a8a-f461-476b-b21f-eaded65c29d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:35:57 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-13067b66-9171-4bcf-8e0e-93e270b95e54 tempest-VolumesActionsTest-1035642129 None] Created volume successfully. Jul 08 14:35:57 devstack sudo[95979]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e17b5169-34d0-4956-bffa-01ad22fe2688 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.272s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:57 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-e17b5169-34d0-4956-bffa-01ad22fe2688 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:35:57 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e17b5169-34d0-4956-bffa-01ad22fe2688 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Deleted volume successfully. Jul 08 14:35:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e17b5169-34d0-4956-bffa-01ad22fe2688 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-567e10d0-af82-4912-8cb5-1ba8b7a5735e-delete_volume" released by "delete_volume" :: held 4.325s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:58 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e0da2a8-bead-4cc2-a022-070e47771cf3 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-feae6f19-509a-435e-b776-6dd7e1a29a6f" returned: 0 in 1.126s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e0da2a8-bead-4cc2-a022-070e47771cf3 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-feae6f19-509a-435e-b776-6dd7e1a29a6f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:58 devstack sudo[95994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-feae6f19-509a-435e-b776-6dd7e1a29a6f Jul 08 14:35:58 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-531fc25a-2498-4ab4-8d64-6a3f8562197d tempest-VolumesActionsTest-2064437360 None] Acquiring lock "cinder-9d8f03ae-ab98-4923-8564-bbe7f142e1c1-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-531fc25a-2498-4ab4-8d64-6a3f8562197d tempest-VolumesActionsTest-2064437360 None] Lock "cinder-9d8f03ae-ab98-4923-8564-bbe7f142e1c1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-531fc25a-2498-4ab4-8d64-6a3f8562197d tempest-VolumesActionsTest-2064437360 None] Acquiring lock "cinder-quobyte-9d8f03ae-ab98-4923-8564-bbe7f142e1c1" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:35:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-531fc25a-2498-4ab4-8d64-6a3f8562197d tempest-VolumesActionsTest-2064437360 None] Lock "cinder-quobyte-9d8f03ae-ab98-4923-8564-bbe7f142e1c1" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:35:58 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[26aa0f74-ec4d-4441-bae4-b9c93b9e4123]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:35:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-531fc25a-2498-4ab4-8d64-6a3f8562197d tempest-VolumesActionsTest-2064437360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9d8f03ae-ab98-4923-8564-bbe7f142e1c1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:58 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9d8f03ae-ab98-4923-8564-bbe7f142e1c1 Jul 08 14:35:58 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:35:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:59 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:35:59 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:35:59 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root Jul 08 14:35:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e0da2a8-bead-4cc2-a022-070e47771cf3 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-feae6f19-509a-435e-b776-6dd7e1a29a6f" returned: 0 in 0.999s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:35:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7e0da2a8-bead-4cc2-a022-070e47771cf3 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-quobyte-feae6f19-509a-435e-b776-6dd7e1a29a6f" released by "delete_volume" :: held 2.236s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:35:59 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-7e0da2a8-bead-4cc2-a022-070e47771cf3 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Created reservations ['27830508-e0a0-4b1f-a267-6430b99ae7d1', 'f6261b58-9447-4e9f-a3a0-590d4d5f8ddc', 'bbe76550-28e0-4325-9771-23b26b3cfe51', 'd063a632-983b-4393-b2d2-63032b633508'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:35:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7e0da2a8-bead-4cc2-a022-070e47771cf3 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:35:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7e0da2a8-bead-4cc2-a022-070e47771cf3 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:35:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7e0da2a8-bead-4cc2-a022-070e47771cf3 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:35:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7e0da2a8-bead-4cc2-a022-070e47771cf3 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:35:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7e0da2a8-bead-4cc2-a022-070e47771cf3 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:35:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e0da2a8-bead-4cc2-a022-070e47771cf3 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:35:59 devstack sudo[96019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:35:59 devstack sudo[96019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:00 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-531fc25a-2498-4ab4-8d64-6a3f8562197d tempest-VolumesActionsTest-2064437360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9d8f03ae-ab98-4923-8564-bbe7f142e1c1" returned: 0 in 1.520s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-531fc25a-2498-4ab4-8d64-6a3f8562197d tempest-VolumesActionsTest-2064437360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9d8f03ae-ab98-4923-8564-bbe7f142e1c1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:00 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:00 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9d8f03ae-ab98-4923-8564-bbe7f142e1c1 Jul 08 14:36:00 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.118s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:36:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:36:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 8 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:36:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:36:00 devstack sudo[96019]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e0da2a8-bead-4cc2-a022-070e47771cf3 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.985s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-7e0da2a8-bead-4cc2-a022-070e47771cf3 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:36:00 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7e0da2a8-bead-4cc2-a022-070e47771cf3 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Deleted volume successfully. Jul 08 14:36:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7e0da2a8-bead-4cc2-a022-070e47771cf3 tempest-CreateVolumesFromSourceVolumeTest-1672702548 None] Lock "cinder-feae6f19-509a-435e-b776-6dd7e1a29a6f-delete_volume" released by "delete_volume" :: held 3.625s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:01 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-531fc25a-2498-4ab4-8d64-6a3f8562197d tempest-VolumesActionsTest-2064437360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9d8f03ae-ab98-4923-8564-bbe7f142e1c1" returned: 0 in 0.828s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-531fc25a-2498-4ab4-8d64-6a3f8562197d tempest-VolumesActionsTest-2064437360 None] Lock "cinder-quobyte-9d8f03ae-ab98-4923-8564-bbe7f142e1c1" released by "delete_volume" :: held 2.397s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:01 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-531fc25a-2498-4ab4-8d64-6a3f8562197d tempest-VolumesActionsTest-2064437360 None] Created reservations ['83007c9c-25ee-4c64-88e3-8ac03fe7e6c9', '49896d8d-4a36-4b04-a53d-b371e882331e', '79430205-b0e8-4601-b52a-7986b219c60b', '9c4094c4-f437-447f-bd49-4bdf2de90643'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:36:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-531fc25a-2498-4ab4-8d64-6a3f8562197d tempest-VolumesActionsTest-2064437360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-531fc25a-2498-4ab4-8d64-6a3f8562197d tempest-VolumesActionsTest-2064437360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-531fc25a-2498-4ab4-8d64-6a3f8562197d tempest-VolumesActionsTest-2064437360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-531fc25a-2498-4ab4-8d64-6a3f8562197d tempest-VolumesActionsTest-2064437360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-531fc25a-2498-4ab4-8d64-6a3f8562197d tempest-VolumesActionsTest-2064437360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-531fc25a-2498-4ab4-8d64-6a3f8562197d tempest-VolumesActionsTest-2064437360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:01 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:36:01 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:02 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-531fc25a-2498-4ab4-8d64-6a3f8562197d tempest-VolumesActionsTest-2064437360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.795s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-531fc25a-2498-4ab4-8d64-6a3f8562197d tempest-VolumesActionsTest-2064437360 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:36:02 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-531fc25a-2498-4ab4-8d64-6a3f8562197d tempest-VolumesActionsTest-2064437360 None] Deleted volume successfully. Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-531fc25a-2498-4ab4-8d64-6a3f8562197d tempest-VolumesActionsTest-2064437360 None] Lock "cinder-9d8f03ae-ab98-4923-8564-bbe7f142e1c1-delete_volume" released by "delete_volume" :: held 3.479s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Flow 'volume_create_manager' (df7ad808-549b-44da-94dc-9acc77c815cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0be125b-596a-44de-a13c-a065307229a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0be125b-596a-44de-a13c-a065307229a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2062741410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215f53bb-ff97-40d4-abe2-ac3ffc262324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d062e082db7742238b6f385a58219200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:03Z,use_quota=True,user_id='2696c54e57e34664b020376dc42b27e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfaf38b2-df07-49c6-b26f-d15304f48608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfaf38b2-df07-49c6-b26f-d15304f48608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd0344e-15b8-4e51-b544-66a75f1b6cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd0344e-15b8-4e51-b544-66a75f1b6cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '215f53bb-ff97-40d4-abe2-ac3ffc262324', 'volume_name': 'volume-215f53bb-ff97-40d4-abe2-ac3ffc262324', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c683ee73-db8f-4811-9587-67a4d77933c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c683ee73-db8f-4811-9587-67a4d77933c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0587ec0d-7ca4-4b99-87ce-41e6872bfdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:02 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Volume 215f53bb-ff97-40d4-abe2-ac3ffc262324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-215f53bb-ff97-40d4-abe2-ac3ffc262324', 'volume_size': 1} Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2062741410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=215f53bb-ff97-40d4-abe2-ac3ffc262324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d062e082db7742238b6f385a58219200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:03Z,use_quota=True,user_id='2696c54e57e34664b020376dc42b27e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Creating volume 215f53bb-ff97-40d4-abe2-ac3ffc262324 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:36:02 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:36:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-215f53bb-ff97-40d4-abe2-ac3ffc262324 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:02 devstack sudo[96033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-215f53bb-ff97-40d4-abe2-ac3ffc262324 1073741824 Jul 08 14:36:02 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:03 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-215f53bb-ff97-40d4-abe2-ac3ffc262324 1073741824" returned: 0 in 1.035s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-215f53bb-ff97-40d4-abe2-ac3ffc262324 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:04 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-215f53bb-ff97-40d4-abe2-ac3ffc262324 Jul 08 14:36:04 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:04 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5803d747-b16d-46bb-91bb-0a2f8e98288c tempest-GroupSnapshotsV319Test-1057280868 None] Group tempest-GroupSnapshotsV319Test-Group-1065904962: creating Jul 08 14:36:04 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5803d747-b16d-46bb-91bb-0a2f8e98288c tempest-GroupSnapshotsV319Test-1057280868 None] Group tempest-GroupSnapshotsV319Test-Group-1065904962: created successfully Jul 08 14:36:04 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5803d747-b16d-46bb-91bb-0a2f8e98288c tempest-GroupSnapshotsV319Test-1057280868 None] Create group completed successfully. Jul 08 14:36:04 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-215f53bb-ff97-40d4-abe2-ac3ffc262324" returned: 0 in 0.697s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:36:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0587ec0d-7ca4-4b99-87ce-41e6872bfdd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-215f53bb-ff97-40d4-abe2-ac3ffc262324', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e926e5-f16e-4c84-90d8-207c33ca3f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:04 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Volume volume-215f53bb-ff97-40d4-abe2-ac3ffc262324 (215f53bb-ff97-40d4-abe2-ac3ffc262324): created successfully Jul 08 14:36:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e926e5-f16e-4c84-90d8-207c33ca3f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Flow 'volume_create_manager' (df7ad808-549b-44da-94dc-9acc77c815cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:04 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-71638311-8e47-4f70-888f-cd00404797af tempest-VolumesActionsTest-1035642129 None] Created volume successfully. Jul 08 14:36:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7173458f-c99d-48c0-9e1a-c0e300acdf46 tempest-VolumesActionsTest-2064437360 None] Acquiring lock "cinder-215f53bb-ff97-40d4-abe2-ac3ffc262324-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7173458f-c99d-48c0-9e1a-c0e300acdf46 tempest-VolumesActionsTest-2064437360 None] Lock "cinder-215f53bb-ff97-40d4-abe2-ac3ffc262324-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7173458f-c99d-48c0-9e1a-c0e300acdf46 tempest-VolumesActionsTest-2064437360 None] Acquiring lock "cinder-quobyte-215f53bb-ff97-40d4-abe2-ac3ffc262324" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7173458f-c99d-48c0-9e1a-c0e300acdf46 tempest-VolumesActionsTest-2064437360 None] Lock "cinder-quobyte-215f53bb-ff97-40d4-abe2-ac3ffc262324" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:05 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5de4b23-4713-4c35-bfb9-03367460c8fb]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7173458f-c99d-48c0-9e1a-c0e300acdf46 tempest-VolumesActionsTest-2064437360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-215f53bb-ff97-40d4-abe2-ac3ffc262324 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:05 devstack sudo[96041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-215f53bb-ff97-40d4-abe2-ac3ffc262324 Jul 08 14:36:05 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:05 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:36:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Flow 'volume_create_manager' (66312cc2-f6cb-4c2e-add4-12c4e42e2493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb5d9b08-2c3d-4fe5-b95c-6f52130eebf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb5d9b08-2c3d-4fe5-b95c-6f52130eebf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1748959367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a3475638494bbf993a7d44a9abcd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:06Z,use_quota=True,user_id='67cd1e903fce4810948b21fbbee82ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c001495b-ece1-4d0c-a1ad-5f778167f0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c001495b-ece1-4d0c-a1ad-5f778167f0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (127e48ed-c76c-4f2e-8ab1-984d4c9d4923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (127e48ed-c76c-4f2e-8ab1-984d4c9d4923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7', 'volume_name': 'volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e524daed-e69e-4152-afbf-e78cfc30709a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e524daed-e69e-4152-afbf-e78cfc30709a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8df920e-5345-40ca-b012-d9399a38f3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:06 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Volume 9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7', 'volume_size': 1} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1748959367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a3475638494bbf993a7d44a9abcd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:06Z,use_quota=True,user_id='67cd1e903fce4810948b21fbbee82ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Creating volume 9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:36:06 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:06 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 1073741824 Jul 08 14:36:06 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:06 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7173458f-c99d-48c0-9e1a-c0e300acdf46 tempest-VolumesActionsTest-2064437360 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-215f53bb-ff97-40d4-abe2-ac3ffc262324" returned: 0 in 1.168s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7173458f-c99d-48c0-9e1a-c0e300acdf46 tempest-VolumesActionsTest-2064437360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-215f53bb-ff97-40d4-abe2-ac3ffc262324 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:06 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-215f53bb-ff97-40d4-abe2-ac3ffc262324 Jul 08 14:36:06 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Flow 'volume_create_manager' (278aa114-3cf6-46a9-b4c9-2998a3a04fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035bf1d8-8b80-4357-95c4-e21393c657bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035bf1d8-8b80-4357-95c4-e21393c657bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-130947897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9dbb85bf-e17a-44a3-a77d-7c192e30948f,host='devstack@QuobyteHD#QuobyteHD',id=eda8ad6f-d530-49e2-a614-6fa9bf0fb427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d5564977354ff19d2d75cc82e49cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:07Z,use_quota=True,user_id='5514c489a9884903a3ee46e0e1218faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c74941d-3272-4b51-a3a8-0de3372812bd),volume_type_id=5c74941d-3272-4b51-a3a8-0de3372812bd)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6744c003-0f60-4f85-ba3a-593c0473113e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6744c003-0f60-4f85-ba3a-593c0473113e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1320d903-f1e1-49a2-80fd-d533d0948db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1320d903-f1e1-49a2-80fd-d533d0948db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eda8ad6f-d530-49e2-a614-6fa9bf0fb427', 'volume_name': 'volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4685c62-d9c1-4dc9-a7bf-4fefeb430228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4685c62-d9c1-4dc9-a7bf-4fefeb430228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad83ea10-baaf-4f98-8161-7634001ea97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:06 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Volume eda8ad6f-d530-49e2-a614-6fa9bf0fb427: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427', 'volume_size': 1} Jul 08 14:36:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:07 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7173458f-c99d-48c0-9e1a-c0e300acdf46 tempest-VolumesActionsTest-2064437360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-215f53bb-ff97-40d4-abe2-ac3ffc262324" returned: 0 in 0.989s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7173458f-c99d-48c0-9e1a-c0e300acdf46 tempest-VolumesActionsTest-2064437360 None] Lock "cinder-quobyte-215f53bb-ff97-40d4-abe2-ac3ffc262324" released by "delete_volume" :: held 2.209s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:07 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-7173458f-c99d-48c0-9e1a-c0e300acdf46 tempest-VolumesActionsTest-2064437360 None] Created reservations ['7d12f380-55e2-454b-934a-360661ae86ae', '9ae837b5-931f-48e7-9ee0-c7bec27abc9c', '1bb52c9e-e45f-48a8-881e-eb28351f678d', '480f6877-d5bc-4c22-a0df-7948fa493c6e'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:36:07 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 1073741824" returned: 0 in 1.368s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7173458f-c99d-48c0-9e1a-c0e300acdf46 tempest-VolumesActionsTest-2064437360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7173458f-c99d-48c0-9e1a-c0e300acdf46 tempest-VolumesActionsTest-2064437360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7173458f-c99d-48c0-9e1a-c0e300acdf46 tempest-VolumesActionsTest-2064437360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7173458f-c99d-48c0-9e1a-c0e300acdf46 tempest-VolumesActionsTest-2064437360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7173458f-c99d-48c0-9e1a-c0e300acdf46 tempest-VolumesActionsTest-2064437360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7173458f-c99d-48c0-9e1a-c0e300acdf46 tempest-VolumesActionsTest-2064437360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:07 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:36:07 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:07 devstack sudo[96057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 Jul 08 14:36:07 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:08 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7" returned: 0 in 0.768s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] <== create_volume: return (2222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:36:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.226s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.424s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9dbb85bf-e17a-44a3-a77d-7c192e30948f,created_at=2026-07-08T12:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-130947897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9dbb85bf-e17a-44a3-a77d-7c192e30948f,host='devstack@QuobyteHD#QuobyteHD',id=eda8ad6f-d530-49e2-a614-6fa9bf0fb427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6d5564977354ff19d2d75cc82e49cc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:07Z,use_quota=True,user_id='5514c489a9884903a3ee46e0e1218faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c74941d-3272-4b51-a3a8-0de3372812bd),volume_type_id=5c74941d-3272-4b51-a3a8-0de3372812bd)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:36:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Creating volume eda8ad6f-d530-49e2-a614-6fa9bf0fb427 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:36:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:36:08 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:36:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8df920e-5345-40ca-b012-d9399a38f3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb55bd49-2f22-4157-a604-a8433cd7283c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:08 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427 1073741824 Jul 08 14:36:08 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:08 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Volume volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 (9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7): created successfully Jul 08 14:36:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb55bd49-2f22-4157-a604-a8433cd7283c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Flow 'volume_create_manager' (66312cc2-f6cb-4c2e-add4-12c4e42e2493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b25366b4-a720-4917-b636-d3b3986133b4 tempest-VolumeDependencyTests-1872524092 None] Created volume successfully. Jul 08 14:36:08 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7173458f-c99d-48c0-9e1a-c0e300acdf46 tempest-VolumesActionsTest-2064437360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.912s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:08 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-7173458f-c99d-48c0-9e1a-c0e300acdf46 tempest-VolumesActionsTest-2064437360 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:36:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7173458f-c99d-48c0-9e1a-c0e300acdf46 tempest-VolumesActionsTest-2064437360 None] Deleted volume successfully. Jul 08 14:36:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7173458f-c99d-48c0-9e1a-c0e300acdf46 tempest-VolumesActionsTest-2064437360 None] Lock "cinder-215f53bb-ff97-40d4-abe2-ac3ffc262324-delete_volume" released by "delete_volume" :: held 3.385s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:09 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:36:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Flow 'volume_create_manager' (26257d39-7fea-42a8-b4aa-465b99fb544a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef99916-0896-4b8d-94d3-dcf6420c39fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bef99916-0896-4b8d-94d3-dcf6420c39fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1331390649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d96e5c1c-c1d8-4497-9769-79d8da2a8d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d062e082db7742238b6f385a58219200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:09Z,use_quota=True,user_id='2696c54e57e34664b020376dc42b27e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87bb040e-814b-435b-bd04-63279229f26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87bb040e-814b-435b-bd04-63279229f26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a329949-94b4-4929-9141-71bc50ae9321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a329949-94b4-4929-9141-71bc50ae9321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd96e5c1c-c1d8-4497-9769-79d8da2a8d48', 'volume_name': 'volume-d96e5c1c-c1d8-4497-9769-79d8da2a8d48', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260f65ad-2c2a-44bc-bcb7-bc3723fa4cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260f65ad-2c2a-44bc-bcb7-bc3723fa4cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7a29e4-6e07-4f52-af58-bdd88577b720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:09 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Volume d96e5c1c-c1d8-4497-9769-79d8da2a8d48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d96e5c1c-c1d8-4497-9769-79d8da2a8d48', 'volume_size': 1} Jul 08 14:36:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cb98b646-bbc3-47ac-a9f3-02649d191cd4 tempest-VolumeDependencyTests-1872524092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:09 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427 1073741824" returned: 0 in 1.217s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:09 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427 Jul 08 14:36:09 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:10 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427" returned: 0 in 0.657s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] <== create_volume: return (1921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:36:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.924s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.953s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1331390649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d96e5c1c-c1d8-4497-9769-79d8da2a8d48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d062e082db7742238b6f385a58219200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:09Z,use_quota=True,user_id='2696c54e57e34664b020376dc42b27e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Creating volume d96e5c1c-c1d8-4497-9769-79d8da2a8d48 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:36:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:36:10 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:36:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d96e5c1c-c1d8-4497-9769-79d8da2a8d48 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad83ea10-baaf-4f98-8161-7634001ea97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:10 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d96e5c1c-c1d8-4497-9769-79d8da2a8d48 1073741824 Jul 08 14:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38b0490-3788-41fa-a6f7-d0045904015f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:10 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:10 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Volume volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427 (eda8ad6f-d530-49e2-a614-6fa9bf0fb427): created successfully Jul 08 14:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38b0490-3788-41fa-a6f7-d0045904015f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Flow 'volume_create_manager' (278aa114-3cf6-46a9-b4c9-2998a3a04fc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:10 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-13f08d6e-6d2e-42c4-b876-aeb6be7a606e tempest-GroupSnapshotsV319Test-1057280868 None] Created volume successfully. Jul 08 14:36:10 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d8226d29-a327-4466-a3fb-f55dc46ae65b tempest-GroupSnapshotsV319Test-1057280868 None] GroupSnapshot a0d95fcc-910e-406e-8c86-94475bbf5f67: creating. Jul 08 14:36:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d8226d29-a327-4466-a3fb-f55dc46ae65b tempest-GroupSnapshotsV319Test-1057280868 None] Group snapshot a0d95fcc-910e-406e-8c86-94475bbf5f67: creating. {{(pid=87240) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 14:36:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d8226d29-a327-4466-a3fb-f55dc46ae65b tempest-GroupSnapshotsV319Test-1057280868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:11 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d96e5c1c-c1d8-4497-9769-79d8da2a8d48 1073741824" returned: 0 in 0.934s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d96e5c1c-c1d8-4497-9769-79d8da2a8d48 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:11 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d96e5c1c-c1d8-4497-9769-79d8da2a8d48 Jul 08 14:36:11 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:11 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d96e5c1c-c1d8-4497-9769-79d8da2a8d48" returned: 0 in 0.714s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:36:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cb98b646-bbc3-47ac-a9f3-02649d191cd4 tempest-VolumeDependencyTests-1872524092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.409s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-cb98b646-bbc3-47ac-a9f3-02649d191cd4 tempest-VolumeDependencyTests-1872524092 None] Creating offline snapshot ed29d805-9c9b-4238-9c0a-1a88163f3b56 of volume 9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:36:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd7a29e4-6e07-4f52-af58-bdd88577b720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d96e5c1c-c1d8-4497-9769-79d8da2a8d48', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4651513f-8c76-4567-84fd-60e041f598e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:12 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[329500cc-1cb2-4174-9743-1a4f774083ef]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cb98b646-bbc3-47ac-a9f3-02649d191cd4 tempest-VolumeDependencyTests-1872524092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:12 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Volume volume-d96e5c1c-c1d8-4497-9769-79d8da2a8d48 (d96e5c1c-c1d8-4497-9769-79d8da2a8d48): created successfully Jul 08 14:36:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4651513f-8c76-4567-84fd-60e041f598e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Flow 'volume_create_manager' (26257d39-7fea-42a8-b4aa-465b99fb544a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:12 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c0bf873e-89fa-4c93-81f7-25def9a5a655 tempest-VolumesActionsTest-1035642129 None] Created volume successfully. Jul 08 14:36:12 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:36:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Flow 'volume_create_manager' (a1a9421b-5618-48c3-8315-cf7fd2a5e606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07e99f6-5b36-450f-b567-a3b0b19c7e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07e99f6-5b36-450f-b567-a3b0b19c7e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1289035059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0dd36ce-6b5d-4516-b0f8-8ee502b45f83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48e5053ea594cb8b8007ac72a44f4c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:12Z,use_quota=True,user_id='19d1a5694f174a8aa027528642e4ef2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad151bb-03e0-4609-bad3-b6eb3cc30e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ad151bb-03e0-4609-bad3-b6eb3cc30e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e54088-eaac-49d8-95cb-7def3243a6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54e54088-eaac-49d8-95cb-7def3243a6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0dd36ce-6b5d-4516-b0f8-8ee502b45f83', 'volume_name': 'volume-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134cc781-5e05-490f-86a6-5011db91a9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:12 devstack sudo[96083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 Jul 08 14:36:12 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134cc781-5e05-490f-86a6-5011db91a9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979bc3cf-82f3-4c1d-8945-9c660e0c49c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:12 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Volume f0dd36ce-6b5d-4516-b0f8-8ee502b45f83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83', 'volume_size': 1} Jul 08 14:36:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7a27e680-c59b-4443-ae8a-21c19f9e117d tempest-VolumesActionsTest-1035642129 None] Acquiring lock "cinder-d96e5c1c-c1d8-4497-9769-79d8da2a8d48-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7a27e680-c59b-4443-ae8a-21c19f9e117d tempest-VolumesActionsTest-1035642129 None] Lock "cinder-d96e5c1c-c1d8-4497-9769-79d8da2a8d48-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:12 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cb98b646-bbc3-47ac-a9f3-02649d191cd4 tempest-VolumeDependencyTests-1872524092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7" returned: 0 in 0.934s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cb98b646-bbc3-47ac-a9f3-02649d191cd4 tempest-VolumeDependencyTests-1872524092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.ed29d805-9c9b-4238-9c0a-1a88163f3b56 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7a27e680-c59b-4443-ae8a-21c19f9e117d tempest-VolumesActionsTest-1035642129 None] Acquiring lock "cinder-quobyte-d96e5c1c-c1d8-4497-9769-79d8da2a8d48" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:12 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.ed29d805-9c9b-4238-9c0a-1a88163f3b56 1G Jul 08 14:36:12 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7a27e680-c59b-4443-ae8a-21c19f9e117d tempest-VolumesActionsTest-1035642129 None] Lock "cinder-quobyte-d96e5c1c-c1d8-4497-9769-79d8da2a8d48" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:13 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c607fdd9-90f6-4743-97da-8b7fdc179cfe]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7a27e680-c59b-4443-ae8a-21c19f9e117d tempest-VolumesActionsTest-1035642129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d96e5c1c-c1d8-4497-9769-79d8da2a8d48 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:13 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d96e5c1c-c1d8-4497-9769-79d8da2a8d48 Jul 08 14:36:13 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:13 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cb98b646-bbc3-47ac-a9f3-02649d191cd4 tempest-VolumeDependencyTests-1872524092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.ed29d805-9c9b-4238-9c0a-1a88163f3b56 1G" returned: 0 in 0.888s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cb98b646-bbc3-47ac-a9f3-02649d191cd4 tempest-VolumeDependencyTests-1872524092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.ed29d805-9c9b-4238-9c0a-1a88163f3b56 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:13 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7a27e680-c59b-4443-ae8a-21c19f9e117d tempest-VolumesActionsTest-1035642129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d96e5c1c-c1d8-4497-9769-79d8da2a8d48" returned: 0 in 0.847s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7a27e680-c59b-4443-ae8a-21c19f9e117d tempest-VolumesActionsTest-1035642129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d96e5c1c-c1d8-4497-9769-79d8da2a8d48 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:13 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.ed29d805-9c9b-4238-9c0a-1a88163f3b56 Jul 08 14:36:13 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:13 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d96e5c1c-c1d8-4497-9769-79d8da2a8d48 Jul 08 14:36:13 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:14 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7a27e680-c59b-4443-ae8a-21c19f9e117d tempest-VolumesActionsTest-1035642129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d96e5c1c-c1d8-4497-9769-79d8da2a8d48" returned: 0 in 0.696s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7a27e680-c59b-4443-ae8a-21c19f9e117d tempest-VolumesActionsTest-1035642129 None] Lock "cinder-quobyte-d96e5c1c-c1d8-4497-9769-79d8da2a8d48" released by "delete_volume" :: held 1.581s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:14 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cb98b646-bbc3-47ac-a9f3-02649d191cd4 tempest-VolumeDependencyTests-1872524092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.ed29d805-9c9b-4238-9c0a-1a88163f3b56" returned: 0 in 0.789s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:14 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-cb98b646-bbc3-47ac-a9f3-02649d191cd4 tempest-VolumeDependencyTests-1872524092 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.ed29d805-9c9b-4238-9c0a-1a88163f3b56 is being set with open permissions: ugo+rw Jul 08 14:36:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cb98b646-bbc3-47ac-a9f3-02649d191cd4 tempest-VolumeDependencyTests-1872524092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.ed29d805-9c9b-4238-9c0a-1a88163f3b56 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:14 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-7a27e680-c59b-4443-ae8a-21c19f9e117d tempest-VolumesActionsTest-1035642129 None] Created reservations ['71d8eaa5-35f6-44c4-9473-49aa3e6920d8', 'e0aae2b5-ce90-46a0-bb73-c1efa9e48843', '4e491908-4745-4262-8eae-c8a3132063a0', 'a0857c72-c1c2-449b-ac7d-18f06e6e7282'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:36:14 devstack sudo[96108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.ed29d805-9c9b-4238-9c0a-1a88163f3b56 Jul 08 14:36:14 devstack sudo[96108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7a27e680-c59b-4443-ae8a-21c19f9e117d tempest-VolumesActionsTest-1035642129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7a27e680-c59b-4443-ae8a-21c19f9e117d tempest-VolumesActionsTest-1035642129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7a27e680-c59b-4443-ae8a-21c19f9e117d tempest-VolumesActionsTest-1035642129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7a27e680-c59b-4443-ae8a-21c19f9e117d tempest-VolumesActionsTest-1035642129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7a27e680-c59b-4443-ae8a-21c19f9e117d tempest-VolumesActionsTest-1035642129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7a27e680-c59b-4443-ae8a-21c19f9e117d tempest-VolumesActionsTest-1035642129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:14 devstack sudo[96110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:36:14 devstack sudo[96110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:15 devstack sudo[96108]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cb98b646-bbc3-47ac-a9f3-02649d191cd4 tempest-VolumeDependencyTests-1872524092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.ed29d805-9c9b-4238-9c0a-1a88163f3b56" returned: 0 in 0.726s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cb98b646-bbc3-47ac-a9f3-02649d191cd4 tempest-VolumeDependencyTests-1872524092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:15 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.info Jul 08 14:36:15 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:15 devstack sudo[96110]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7a27e680-c59b-4443-ae8a-21c19f9e117d tempest-VolumesActionsTest-1035642129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.789s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:15 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-7a27e680-c59b-4443-ae8a-21c19f9e117d tempest-VolumesActionsTest-1035642129 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:36:15 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7a27e680-c59b-4443-ae8a-21c19f9e117d tempest-VolumesActionsTest-1035642129 None] Deleted volume successfully. Jul 08 14:36:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7a27e680-c59b-4443-ae8a-21c19f9e117d tempest-VolumesActionsTest-1035642129 None] Lock "cinder-d96e5c1c-c1d8-4497-9769-79d8da2a8d48-delete_volume" released by "delete_volume" :: held 2.637s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:16 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cb98b646-bbc3-47ac-a9f3-02649d191cd4 tempest-VolumeDependencyTests-1872524092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.info" returned: 0 in 0.825s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:16 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-cb98b646-bbc3-47ac-a9f3-02649d191cd4 tempest-VolumeDependencyTests-1872524092 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.info is being set with open permissions: ugo+rw Jul 08 14:36:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cb98b646-bbc3-47ac-a9f3-02649d191cd4 tempest-VolumeDependencyTests-1872524092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:16 devstack sudo[96118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.info Jul 08 14:36:16 devstack sudo[96118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:16 devstack sudo[96118]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cb98b646-bbc3-47ac-a9f3-02649d191cd4 tempest-VolumeDependencyTests-1872524092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.info" returned: 0 in 0.717s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cb98b646-bbc3-47ac-a9f3-02649d191cd4 tempest-VolumeDependencyTests-1872524092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.052s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d8226d29-a327-4466-a3fb-f55dc46ae65b tempest-GroupSnapshotsV319Test-1057280868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.179s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d8226d29-a327-4466-a3fb-f55dc46ae65b tempest-GroupSnapshotsV319Test-1057280868 None] Creating offline snapshot a55b4d79-760d-4961-a392-f288bf409a94 of volume eda8ad6f-d530-49e2-a614-6fa9bf0fb427 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:36:17 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-cb98b646-bbc3-47ac-a9f3-02649d191cd4 tempest-VolumeDependencyTests-1872524092 None] Create snapshot completed successfully Jul 08 14:36:17 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6422cc1-ea69-4f02-80a9-03b7db51c7f8]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d8226d29-a327-4466-a3fb-f55dc46ae65b tempest-GroupSnapshotsV319Test-1057280868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:17 devstack sudo[96122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427 Jul 08 14:36:17 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:17 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d8226d29-a327-4466-a3fb-f55dc46ae65b tempest-GroupSnapshotsV319Test-1057280868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427" returned: 0 in 0.892s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d8226d29-a327-4466-a3fb-f55dc46ae65b tempest-GroupSnapshotsV319Test-1057280868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.a55b4d79-760d-4961-a392-f288bf409a94 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:17 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.a55b4d79-760d-4961-a392-f288bf409a94 1G Jul 08 14:36:17 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:18 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=190,cinder:SELECT=148,cinder:INSERT=40,cinder:DELETE=14 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Flow 'volume_create_manager' (6808171b-94ca-41b1-9754-8ea758dc3cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622fbfeb-9cd8-4c30-bac3-1bb690f4d23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (622fbfeb-9cd8-4c30-bac3-1bb690f4d23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-747648998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6a3475638494bbf993a7d44a9abcd12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ed29d805-9c9b-4238-9c0a-1a88163f3b56,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:19Z,use_quota=True,user_id='67cd1e903fce4810948b21fbbee82ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e3405e-e3c4-4d74-889c-6502c34727de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e3405e-e3c4-4d74-889c-6502c34727de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52d16f9-6497-4648-9389-d9c09dc9b6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e52d16f9-6497-4648-9389-d9c09dc9b6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262', 'volume_name': 'volume-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262', 'volume_size': 1, 'snapshot_id': 'ed29d805-9c9b-4238-9c0a-1a88163f3b56'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43bac8bd-4a68-46d7-b4bb-25f62febcf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43bac8bd-4a68-46d7-b4bb-25f62febcf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903cb7e5-5224-4b89-94b3-5b964667faad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:18 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Volume 9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262', 'volume_size': 1, 'snapshot_id': 'ed29d805-9c9b-4238-9c0a-1a88163f3b56'} Jul 08 14:36:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:18 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d8226d29-a327-4466-a3fb-f55dc46ae65b tempest-GroupSnapshotsV319Test-1057280868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.a55b4d79-760d-4961-a392-f288bf409a94 1G" returned: 0 in 1.077s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d8226d29-a327-4466-a3fb-f55dc46ae65b tempest-GroupSnapshotsV319Test-1057280868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.a55b4d79-760d-4961-a392-f288bf409a94 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:19 devstack sudo[96133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.a55b4d79-760d-4961-a392-f288bf409a94 Jul 08 14:36:19 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:19 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d8226d29-a327-4466-a3fb-f55dc46ae65b tempest-GroupSnapshotsV319Test-1057280868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.a55b4d79-760d-4961-a392-f288bf409a94" returned: 0 in 0.836s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:19 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-d8226d29-a327-4466-a3fb-f55dc46ae65b tempest-GroupSnapshotsV319Test-1057280868 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.a55b4d79-760d-4961-a392-f288bf409a94 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:36:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d8226d29-a327-4466-a3fb-f55dc46ae65b tempest-GroupSnapshotsV319Test-1057280868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.a55b4d79-760d-4961-a392-f288bf409a94 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:19 devstack sudo[96139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.a55b4d79-760d-4961-a392-f288bf409a94 Jul 08 14:36:19 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:20 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d8226d29-a327-4466-a3fb-f55dc46ae65b tempest-GroupSnapshotsV319Test-1057280868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.a55b4d79-760d-4961-a392-f288bf409a94" returned: 0 in 0.820s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d8226d29-a327-4466-a3fb-f55dc46ae65b tempest-GroupSnapshotsV319Test-1057280868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:20 devstack sudo[96142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.info Jul 08 14:36:20 devstack sudo[96142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:21 devstack sudo[96142]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d8226d29-a327-4466-a3fb-f55dc46ae65b tempest-GroupSnapshotsV319Test-1057280868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.info" returned: 0 in 0.838s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:21 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-d8226d29-a327-4466-a3fb-f55dc46ae65b tempest-GroupSnapshotsV319Test-1057280868 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:36:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d8226d29-a327-4466-a3fb-f55dc46ae65b tempest-GroupSnapshotsV319Test-1057280868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:21 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.info Jul 08 14:36:21 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:22 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d8226d29-a327-4466-a3fb-f55dc46ae65b tempest-GroupSnapshotsV319Test-1057280868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.info" returned: 0 in 0.719s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d8226d29-a327-4466-a3fb-f55dc46ae65b tempest-GroupSnapshotsV319Test-1057280868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.304s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.111s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1289035059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0dd36ce-6b5d-4516-b0f8-8ee502b45f83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48e5053ea594cb8b8007ac72a44f4c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:12Z,use_quota=True,user_id='19d1a5694f174a8aa027528642e4ef2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:36:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Creating volume f0dd36ce-6b5d-4516-b0f8-8ee502b45f83 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:36:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:36:22 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:36:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:22 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83 1073741824 Jul 08 14:36:22 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:22 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d8226d29-a327-4466-a3fb-f55dc46ae65b tempest-GroupSnapshotsV319Test-1057280868 None] group_snapshot a0d95fcc-910e-406e-8c86-94475bbf5f67: created successfully Jul 08 14:36:23 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ec2f66a5-fac7-47aa-965c-56a03da1b9ad tempest-GroupSnapshotsV319Test-1057280868 None] group_snapshot a0d95fcc-910e-406e-8c86-94475bbf5f67: deleting Jul 08 14:36:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ec2f66a5-fac7-47aa-965c-56a03da1b9ad tempest-GroupSnapshotsV319Test-1057280868 None] group_snapshot a0d95fcc-910e-406e-8c86-94475bbf5f67: deleting {{(pid=87240) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 14:36:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ec2f66a5-fac7-47aa-965c-56a03da1b9ad tempest-GroupSnapshotsV319Test-1057280868 None] Acquiring lock "cinder-quobyte-eda8ad6f-d530-49e2-a614-6fa9bf0fb427" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ec2f66a5-fac7-47aa-965c-56a03da1b9ad tempest-GroupSnapshotsV319Test-1057280868 None] Lock "cinder-quobyte-eda8ad6f-d530-49e2-a614-6fa9bf0fb427" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ec2f66a5-fac7-47aa-965c-56a03da1b9ad tempest-GroupSnapshotsV319Test-1057280868 None] Acquiring lock "cinder-quobyte-a55b4d79-760d-4961-a392-f288bf409a94" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ec2f66a5-fac7-47aa-965c-56a03da1b9ad tempest-GroupSnapshotsV319Test-1057280868 None] Lock "cinder-quobyte-a55b4d79-760d-4961-a392-f288bf409a94" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ec2f66a5-fac7-47aa-965c-56a03da1b9ad tempest-GroupSnapshotsV319Test-1057280868 None] Deleting offline snapshot a55b4d79-760d-4961-a392-f288bf409a94 of volume eda8ad6f-d530-49e2-a614-6fa9bf0fb427 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:36:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ec2f66a5-fac7-47aa-965c-56a03da1b9ad tempest-GroupSnapshotsV319Test-1057280868 None] snapshot_file for this snap is: volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.a55b4d79-760d-4961-a392-f288bf409a94 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:36:23 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[926fbf11-be92-4655-bc07-8995d545710c]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec2f66a5-fac7-47aa-965c-56a03da1b9ad tempest-GroupSnapshotsV319Test-1057280868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.a55b4d79-760d-4961-a392-f288bf409a94 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:23 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.a55b4d79-760d-4961-a392-f288bf409a94 Jul 08 14:36:23 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:23 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83 1073741824" returned: 0 in 1.367s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:23 devstack sudo[96158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83 Jul 08 14:36:23 devstack sudo[96158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:24 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec2f66a5-fac7-47aa-965c-56a03da1b9ad tempest-GroupSnapshotsV319Test-1057280868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.a55b4d79-760d-4961-a392-f288bf409a94" returned: 0 in 1.128s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ec2f66a5-fac7-47aa-965c-56a03da1b9ad tempest-GroupSnapshotsV319Test-1057280868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0d2ab4-a621-4448-b706-bb18c870c88f]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec2f66a5-fac7-47aa-965c-56a03da1b9ad tempest-GroupSnapshotsV319Test-1057280868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:24 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427 Jul 08 14:36:24 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:24 devstack sudo[96158]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83" returned: 0 in 0.951s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] <== create_volume: return (2384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.388s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 5.879s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Acquiring lock "cinder-quobyte-ed29d805-9c9b-4238-9c0a-1a88163f3b56-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262" by "_create_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (979bc3cf-82f3-4c1d-8945-9c660e0c49c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c30e8019-13c7-4457-8729-10da1666c3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Lock "cinder-quobyte-ed29d805-9c9b-4238-9c0a-1a88163f3b56-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262" acquired by "_create_volume_from_snapshot" :: waited 0.064s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Creating volume 9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262 from snapshot ed29d805-9c9b-4238-9c0a-1a88163f3b56 {{(pid=87240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Acquiring lock "cinder-quobyte-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:24 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Volume volume-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83 (f0dd36ce-6b5d-4516-b0f8-8ee502b45f83): created successfully Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c30e8019-13c7-4457-8729-10da1666c3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Flow 'volume_create_manager' (a1a9421b-5618-48c3-8315-cf7fd2a5e606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Lock "cinder-quobyte-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] snapshot: ed29d805-9c9b-4238-9c0a-1a88163f3b56, volume: 9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:36:24 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-16da2e45-2c51-4c12-8b22-19f71521a3ba tempest-AttachVolumeNegativeTest-1089741081 None] Created volume successfully. Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d9669d-6b11-4887-90d7-87b3e0b785e2]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.ed29d805-9c9b-4238-9c0a-1a88163f3b56 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:25 devstack sudo[96168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.ed29d805-9c9b-4238-9c0a-1a88163f3b56 Jul 08 14:36:25 devstack sudo[96168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:25 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec2f66a5-fac7-47aa-965c-56a03da1b9ad tempest-GroupSnapshotsV319Test-1057280868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427" returned: 0 in 1.043s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec2f66a5-fac7-47aa-965c-56a03da1b9ad tempest-GroupSnapshotsV319Test-1057280868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.a55b4d79-760d-4961-a392-f288bf409a94 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:25 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.a55b4d79-760d-4961-a392-f288bf409a94 Jul 08 14:36:25 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:25 devstack sudo[96168]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.ed29d805-9c9b-4238-9c0a-1a88163f3b56" returned: 0 in 1.054s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:36:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:36:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:36:25 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[74faf0f8-1b8a-459a-8eeb-434b1cc46cd0]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:26 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 Jul 08 14:36:26 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:26 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec2f66a5-fac7-47aa-965c-56a03da1b9ad tempest-GroupSnapshotsV319Test-1057280868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.a55b4d79-760d-4961-a392-f288bf409a94" returned: 0 in 1.102s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec2f66a5-fac7-47aa-965c-56a03da1b9ad tempest-GroupSnapshotsV319Test-1057280868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.a55b4d79-760d-4961-a392-f288bf409a94 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:26 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.a55b4d79-760d-4961-a392-f288bf409a94 Jul 08 14:36:26 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:26 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7" returned: 0 in 0.950s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:26 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Path /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262 not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:36:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:26 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262 Jul 08 14:36:26 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:27 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ec2f66a5-fac7-47aa-965c-56a03da1b9ad tempest-GroupSnapshotsV319Test-1057280868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427.a55b4d79-760d-4961-a392-f288bf409a94" returned: 0 in 0.856s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ec2f66a5-fac7-47aa-965c-56a03da1b9ad tempest-GroupSnapshotsV319Test-1057280868 None] Lock "cinder-quobyte-a55b4d79-760d-4961-a392-f288bf409a94" released by "_delete_snapshot" :: held 4.275s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ec2f66a5-fac7-47aa-965c-56a03da1b9ad tempest-GroupSnapshotsV319Test-1057280868 None] Lock "cinder-quobyte-eda8ad6f-d530-49e2-a614-6fa9bf0fb427" released by "delete_snapshot" :: held 4.308s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:27 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=114,cinder:UPDATE=158,cinder:INSERT=41,cinder:DELETE=13 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:36:27 devstack cinder-volume[87240]: WARNING cinder.quota [None req-ec2f66a5-fac7-47aa-965c-56a03da1b9ad tempest-GroupSnapshotsV319Test-1057280868 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1236155457 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1236155457, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:36:27 devstack cinder-volume[87240]: WARNING cinder.quota [None req-ec2f66a5-fac7-47aa-965c-56a03da1b9ad tempest-GroupSnapshotsV319Test-1057280868 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1236155457 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1236155457, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:36:27 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-ec2f66a5-fac7-47aa-965c-56a03da1b9ad tempest-GroupSnapshotsV319Test-1057280868 None] Created reservations ['d456c884-402a-4e60-93f8-70534d6f91b2', '0a285ce0-cda9-4315-9351-6eb74a3d7021', 'ba577be0-916f-4d7c-ac09-71f46f753df9', 'ff1636b9-6cf7-4fef-bed0-c2518898666d'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:36:27 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ec2f66a5-fac7-47aa-965c-56a03da1b9ad tempest-GroupSnapshotsV319Test-1057280868 None] group_snapshot a0d95fcc-910e-406e-8c86-94475bbf5f67: deleted successfully Jul 08 14:36:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-09505cc5-c141-4502-a777-5b8906ce37d6 req-f387b3c9-3f8b-46c0-a377-1e4fd34ae07d tempest-AttachVolumeNegativeTest-1089741081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c7d1e60e-f24a-481b-8cce-5830f4bbd043 tempest-GroupSnapshotsV319Test-1057280868 None] Acquiring lock "cinder-quobyte-eda8ad6f-d530-49e2-a614-6fa9bf0fb427" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c7d1e60e-f24a-481b-8cce-5830f4bbd043 tempest-GroupSnapshotsV319Test-1057280868 None] Lock "cinder-quobyte-eda8ad6f-d530-49e2-a614-6fa9bf0fb427" acquired by "delete_volume" :: waited 0.068s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:29 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a924b94-21c0-41f9-90b5-c0474e9a371e]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c7d1e60e-f24a-481b-8cce-5830f4bbd043 tempest-GroupSnapshotsV319Test-1057280868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:30 devstack sudo[96213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427 Jul 08 14:36:30 devstack sudo[96213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:32 devstack sudo[96213]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c7d1e60e-f24a-481b-8cce-5830f4bbd043 tempest-GroupSnapshotsV319Test-1057280868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427" returned: 0 in 2.314s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c7d1e60e-f24a-481b-8cce-5830f4bbd043 tempest-GroupSnapshotsV319Test-1057280868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:32 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427 Jul 08 14:36:32 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:32 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262" returned: 0 in 5.981s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:32 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1f3f76-2266-401a-9493-980eae7f7140]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:33 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 Jul 08 14:36:33 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:33 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c7d1e60e-f24a-481b-8cce-5830f4bbd043 tempest-GroupSnapshotsV319Test-1057280868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-eda8ad6f-d530-49e2-a614-6fa9bf0fb427" returned: 0 in 1.163s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:33 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c7d1e60e-f24a-481b-8cce-5830f4bbd043 tempest-GroupSnapshotsV319Test-1057280868 None] Lock "cinder-quobyte-eda8ad6f-d530-49e2-a614-6fa9bf0fb427" released by "delete_volume" :: held 3.663s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:33 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-c7d1e60e-f24a-481b-8cce-5830f4bbd043 tempest-GroupSnapshotsV319Test-1057280868 None] Created reservations ['570d0148-3334-4045-908b-c54e254d735e'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:36:33 devstack cinder-volume[87240]: WARNING cinder.quota [None req-c7d1e60e-f24a-481b-8cce-5830f4bbd043 tempest-GroupSnapshotsV319Test-1057280868 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1236155457 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1236155457, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:36:33 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-c7d1e60e-f24a-481b-8cce-5830f4bbd043 tempest-GroupSnapshotsV319Test-1057280868 None] Created reservations ['b3586114-4c2d-4c01-8cff-7747751653fe', '7386a602-a514-4aba-a558-9e0b1a350c0b', '0cda8a57-9004-4ffc-8410-1d1fa843129a', 'd8351902-96b8-4610-b4ab-838172772b4a'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:36:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7d1e60e-f24a-481b-8cce-5830f4bbd043 tempest-GroupSnapshotsV319Test-1057280868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7d1e60e-f24a-481b-8cce-5830f4bbd043 tempest-GroupSnapshotsV319Test-1057280868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c7d1e60e-f24a-481b-8cce-5830f4bbd043 tempest-GroupSnapshotsV319Test-1057280868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c7d1e60e-f24a-481b-8cce-5830f4bbd043 tempest-GroupSnapshotsV319Test-1057280868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7d1e60e-f24a-481b-8cce-5830f4bbd043 tempest-GroupSnapshotsV319Test-1057280868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c7d1e60e-f24a-481b-8cce-5830f4bbd043 tempest-GroupSnapshotsV319Test-1057280868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:33 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:36:33 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:34 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7" returned: 0 in 1.180s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:34 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Image conversion details: src /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7, size 1024.00 MB, duration 5.98 sec, destination /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:36:34 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Converted 1024.00 MB image at 171.14 MB/s Jul 08 14:36:34 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262 is being set with open permissions: ugo+rw Jul 08 14:36:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:34 devstack sudo[96230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262 Jul 08 14:36:34 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:34 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c7d1e60e-f24a-481b-8cce-5830f4bbd043 tempest-GroupSnapshotsV319Test-1057280868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.796s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:34 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-c7d1e60e-f24a-481b-8cce-5830f4bbd043 tempest-GroupSnapshotsV319Test-1057280868 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:36:34 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c7d1e60e-f24a-481b-8cce-5830f4bbd043 tempest-GroupSnapshotsV319Test-1057280868 None] Delete group completed successfully. Jul 08 14:36:34 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262" returned: 0 in 0.794s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Lock "cinder-quobyte-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262" released by "_copy_volume_from_snapshot" :: held 10.098s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Lock "cinder-quobyte-ed29d805-9c9b-4238-9c0a-1a88163f3b56-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262" released by "_create_volume_from_snapshot" :: held 10.169s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.237s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-09505cc5-c141-4502-a777-5b8906ce37d6 req-f387b3c9-3f8b-46c0-a377-1e4fd34ae07d tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.596s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:34 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6879a7a6-efa9-467c-84ba-c7a008973719]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-09505cc5-c141-4502-a777-5b8906ce37d6 req-f387b3c9-3f8b-46c0-a377-1e4fd34ae07d tempest-AttachVolumeNegativeTest-1089741081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903cb7e5-5224-4b89-94b3-5b964667faad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262', 'volume_size': 1, 'snapshot_id': 'ed29d805-9c9b-4238-9c0a-1a88163f3b56'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c408e32-39c7-487a-bb50-417faf245ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:35 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Volume volume-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262 (9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262): created successfully Jul 08 14:36:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c408e32-39c7-487a-bb50-417faf245ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Flow 'volume_create_manager' (6808171b-94ca-41b1-9754-8ea758dc3cb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:35 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e6fdc465-7b55-45a5-8b3e-e32f85a8bd70 tempest-VolumeDependencyTests-1872524092 None] Created volume successfully. Jul 08 14:36:35 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83 Jul 08 14:36:35 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:35 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:36:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Flow 'volume_create_manager' (945a028e-52a7-4f0e-a7e1-5debce5f2d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c82c4cf-f2c5-40d1-8840-7923d639c09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c82c4cf-f2c5-40d1-8840-7923d639c09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-120875825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc15424-9d84-4973-97b2-df177ad84f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5df5713c4cf142739563a92e761e2b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:35Z,use_quota=True,user_id='d8fca737418c4eecb2d5eadf00e24222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c1feb4-cb47-4620-9d15-414c6f8501db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1c1feb4-cb47-4620-9d15-414c6f8501db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f757d047-3368-4945-ae17-a28384e679e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:35 devstack cinder-volume[87240]: DEBUG cinder.image.glance [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Creating Keystone auth plugin from conf {{(pid=87240) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 14:36:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a2404872-bd45-43f4-ad92-04fe56127088 tempest-VolumeDependencyTests-1872524092 None] Acquiring lock "cinder-ed29d805-9c9b-4238-9c0a-1a88163f3b56-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a2404872-bd45-43f4-ad92-04fe56127088 tempest-VolumeDependencyTests-1872524092 None] Lock "cinder-ed29d805-9c9b-4238-9c0a-1a88163f3b56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a2404872-bd45-43f4-ad92-04fe56127088 tempest-VolumeDependencyTests-1872524092 None] Acquiring lock "cinder-quobyte-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a2404872-bd45-43f4-ad92-04fe56127088 tempest-VolumeDependencyTests-1872524092 None] Lock "cinder-quobyte-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a2404872-bd45-43f4-ad92-04fe56127088 tempest-VolumeDependencyTests-1872524092 None] Acquiring lock "cinder-quobyte-ed29d805-9c9b-4238-9c0a-1a88163f3b56" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a2404872-bd45-43f4-ad92-04fe56127088 tempest-VolumeDependencyTests-1872524092 None] Lock "cinder-quobyte-ed29d805-9c9b-4238-9c0a-1a88163f3b56" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a2404872-bd45-43f4-ad92-04fe56127088 tempest-VolumeDependencyTests-1872524092 None] Deleting offline snapshot ed29d805-9c9b-4238-9c0a-1a88163f3b56 of volume 9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:36:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a2404872-bd45-43f4-ad92-04fe56127088 tempest-VolumeDependencyTests-1872524092 None] snapshot_file for this snap is: volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.ed29d805-9c9b-4238-9c0a-1a88163f3b56 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:36:35 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc4a9e6-772c-4417-b298-635bf056affa]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a2404872-bd45-43f4-ad92-04fe56127088 tempest-VolumeDependencyTests-1872524092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.ed29d805-9c9b-4238-9c0a-1a88163f3b56 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:35 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.ed29d805-9c9b-4238-9c0a-1a88163f3b56 Jul 08 14:36:35 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:36 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-09505cc5-c141-4502-a777-5b8906ce37d6 req-f387b3c9-3f8b-46c0-a377-1e4fd34ae07d tempest-AttachVolumeNegativeTest-1089741081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83" returned: 0 in 1.055s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-09505cc5-c141-4502-a777-5b8906ce37d6 req-f387b3c9-3f8b-46c0-a377-1e4fd34ae07d tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.097s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-09505cc5-c141-4502-a777-5b8906ce37d6 req-f387b3c9-3f8b-46c0-a377-1e4fd34ae07d tempest-AttachVolumeNegativeTest-1089741081 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad', 'name': 'volume-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bee9bc17-0df2-4cda-b02d-8633b0d44abb', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:36:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f757d047-3368-4945-ae17-a28384e679e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2dc15424-9d84-4973-97b2-df177ad84f00', 'volume_name': 'volume-2dc15424-9d84-4973-97b2-df177ad84f00', 'volume_size': 1, 'image_id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f84c09b9fe464edfa51b7a3d44e3b143', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58737c52-dd55-48f3-a217-6bd4f5b7f47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58737c52-dd55-48f3-a217-6bd4f5b7f47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d488729-38ae-4f19-a7a4-06740697beec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:36 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Volume 2dc15424-9d84-4973-97b2-df177ad84f00: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2dc15424-9d84-4973-97b2-df177ad84f00', 'volume_size': 1, 'image_id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f84c09b9fe464edfa51b7a3d44e3b143', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 14:36:36 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Trying to clone 2dc15424-9d84-4973-97b2-df177ad84f00 from image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}]). {{(pid=87240) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 14:36:36 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-09505cc5-c141-4502-a777-5b8906ce37d6 req-f387b3c9-3f8b-46c0-a377-1e4fd34ae07d tempest-AttachVolumeNegativeTest-1089741081 None] attachment_update completed successfully. Jul 08 14:36:36 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a2404872-bd45-43f4-ad92-04fe56127088 tempest-VolumeDependencyTests-1872524092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.ed29d805-9c9b-4238-9c0a-1a88163f3b56" returned: 0 in 1.188s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a2404872-bd45-43f4-ad92-04fe56127088 tempest-VolumeDependencyTests-1872524092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:36:36 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[411f62db-13de-4761-af4a-227b718fadbb]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a2404872-bd45-43f4-ad92-04fe56127088 tempest-VolumeDependencyTests-1872524092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:36 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_8u38dkszdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 14:36:36 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Image download 20.69 MB at 20.69 MB/s Jul 08 14:36:36 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a07592-2029-4c58-9574-918a33406b9b]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_8u38dkszdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:36 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 Jul 08 14:36:36 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:37 devstack sudo[96651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_8u38dkszdevstack@QuobyteHD Jul 08 14:36:37 devstack sudo[96651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:37 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a2404872-bd45-43f4-ad92-04fe56127088 tempest-VolumeDependencyTests-1872524092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7" returned: 0 in 1.086s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a2404872-bd45-43f4-ad92-04fe56127088 tempest-VolumeDependencyTests-1872524092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.ed29d805-9c9b-4238-9c0a-1a88163f3b56 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:37 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.ed29d805-9c9b-4238-9c0a-1a88163f3b56 Jul 08 14:36:37 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:37 devstack sudo[96651]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_8u38dkszdevstack@QuobyteHD" returned: 0 in 1.043s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:37 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Temporary image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 is fetched for user d8fca737418c4eecb2d5eadf00e24222. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 14:36:37 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb8f944-3ba9-4d62-9179-5aff1b05b78d]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_8u38dkszdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:38 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_8u38dkszdevstack@QuobyteHD Jul 08 14:36:38 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:38 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a2404872-bd45-43f4-ad92-04fe56127088 tempest-VolumeDependencyTests-1872524092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.ed29d805-9c9b-4238-9c0a-1a88163f3b56" returned: 0 in 0.887s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a2404872-bd45-43f4-ad92-04fe56127088 tempest-VolumeDependencyTests-1872524092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.ed29d805-9c9b-4238-9c0a-1a88163f3b56 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:38 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.ed29d805-9c9b-4238-9c0a-1a88163f3b56 Jul 08 14:36:38 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:38 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_8u38dkszdevstack@QuobyteHD" returned: 0 in 0.924s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-120875825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc15424-9d84-4973-97b2-df177ad84f00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5df5713c4cf142739563a92e761e2b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:35Z,use_quota=True,user_id='d8fca737418c4eecb2d5eadf00e24222',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:36:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Creating volume 2dc15424-9d84-4973-97b2-df177ad84f00 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:36:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:36:38 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:36:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:38 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00 1073741824 Jul 08 14:36:38 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:39 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a2404872-bd45-43f4-ad92-04fe56127088 tempest-VolumeDependencyTests-1872524092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7.ed29d805-9c9b-4238-9c0a-1a88163f3b56" returned: 0 in 0.826s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a2404872-bd45-43f4-ad92-04fe56127088 tempest-VolumeDependencyTests-1872524092 None] Lock "cinder-quobyte-ed29d805-9c9b-4238-9c0a-1a88163f3b56" released by "_delete_snapshot" :: held 4.178s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a2404872-bd45-43f4-ad92-04fe56127088 tempest-VolumeDependencyTests-1872524092 None] Lock "cinder-quobyte-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7" released by "delete_snapshot" :: held 4.206s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:39 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-a2404872-bd45-43f4-ad92-04fe56127088 tempest-VolumeDependencyTests-1872524092 None] Created reservations ['fc4dffca-0cbd-4474-bdc1-064232a069c9', 'f95fab05-1daa-4be6-80ea-e23dda12b9ef', 'a4e769bd-5137-4e6a-b2c7-dabc29c085be', 'a4217190-0be1-4f88-be9f-24775d7bc20e'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:36:39 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a2404872-bd45-43f4-ad92-04fe56127088 tempest-VolumeDependencyTests-1872524092 None] Delete snapshot completed successfully. Jul 08 14:36:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a2404872-bd45-43f4-ad92-04fe56127088 tempest-VolumeDependencyTests-1872524092 None] Lock "cinder-ed29d805-9c9b-4238-9c0a-1a88163f3b56-delete_snapshot" released by "delete_snapshot" :: held 4.412s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:40 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00 1073741824" returned: 0 in 1.133s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:40 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00 Jul 08 14:36:40 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-32d9c5a2-fd30-472e-b4e3-c25f855251c5 tempest-VolumeDependencyTests-1872524092 None] Acquiring lock "cinder-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-32d9c5a2-fd30-472e-b4e3-c25f855251c5 tempest-VolumeDependencyTests-1872524092 None] Lock "cinder-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-32d9c5a2-fd30-472e-b4e3-c25f855251c5 tempest-VolumeDependencyTests-1872524092 None] Acquiring lock "cinder-quobyte-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:40 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00" returned: 0 in 0.771s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] <== create_volume: return (1959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:36:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.964s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-32d9c5a2-fd30-472e-b4e3-c25f855251c5 tempest-VolumeDependencyTests-1872524092 None] Lock "cinder-quobyte-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7" acquired by "delete_volume" :: waited 0.037s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:40 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb4368b-69d8-4431-87cd-0ada21edb900]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-32d9c5a2-fd30-472e-b4e3-c25f855251c5 tempest-VolumeDependencyTests-1872524092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:40 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Attempting download of 8a72c3c4-bdc8-4198-ab53-8c7f86124915 ((None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}])) to volume 2dc15424-9d84-4973-97b2-df177ad84f00. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b081b86-2db4-4072-aa45-40a691e83380]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_55712ztx {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:41 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 Jul 08 14:36:41 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:41 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_55712ztx Jul 08 14:36:41 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Flow 'volume_create_manager' (7f2203fc-3e4f-4c67-b038-3780f8c81952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a266f009-b7fb-454e-9e2e-67ccaed6112e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a266f009-b7fb-454e-9e2e-67ccaed6112e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1273771087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e18d35cc-88d0-4389-b9d3-0b6fb2576c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36725c6af0f240a9a12f20e27fba1b91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:42Z,use_quota=True,user_id='4c47f72d3eb249f2a8e3dacc74cd7cbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe215bf7-5d0f-4374-9e3c-9b26dd40d45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe215bf7-5d0f-4374-9e3c-9b26dd40d45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20bb659-0688-4d54-8014-55d8b7795873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20bb659-0688-4d54-8014-55d8b7795873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e18d35cc-88d0-4389-b9d3-0b6fb2576c64', 'volume_name': 'volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777b8a7e-0410-41bb-9034-653894211a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777b8a7e-0410-41bb-9034-653894211a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e21aaab-0091-4be9-b443-70a56e761b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:41 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Volume e18d35cc-88d0-4389-b9d3-0b6fb2576c64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64', 'volume_size': 1} Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1273771087',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e18d35cc-88d0-4389-b9d3-0b6fb2576c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36725c6af0f240a9a12f20e27fba1b91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:42Z,use_quota=True,user_id='4c47f72d3eb249f2a8e3dacc74cd7cbd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Creating volume e18d35cc-88d0-4389-b9d3-0b6fb2576c64 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:36:41 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:36:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:41 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64 1073741824 Jul 08 14:36:41 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:42 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_55712ztx" returned: 0 in 0.975s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_55712ztx {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:42 devstack sudo[96728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_55712ztx Jul 08 14:36:42 devstack sudo[96728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:42 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-32d9c5a2-fd30-472e-b4e3-c25f855251c5 tempest-VolumeDependencyTests-1872524092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7" returned: 0 in 1.418s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-32d9c5a2-fd30-472e-b4e3-c25f855251c5 tempest-VolumeDependencyTests-1872524092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:42 devstack sudo[96733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7 Jul 08 14:36:42 devstack sudo[96733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:42 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64 1073741824" returned: 0 in 0.994s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:42 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64 Jul 08 14:36:42 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:42 devstack sudo[96728]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_55712ztx" returned: 1 in 0.850s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_55712ztx' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:36:42 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7ef56d-babe-43a1-91fb-427bba1d3994]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_8u38dkszdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:43 devstack sudo[96743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_8u38dkszdevstack@QuobyteHD Jul 08 14:36:43 devstack sudo[96743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:43 devstack sudo[96733]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-32d9c5a2-fd30-472e-b4e3-c25f855251c5 tempest-VolumeDependencyTests-1872524092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7" returned: 0 in 0.838s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-32d9c5a2-fd30-472e-b4e3-c25f855251c5 tempest-VolumeDependencyTests-1872524092 None] Lock "cinder-quobyte-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7" released by "delete_volume" :: held 2.348s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-32d9c5a2-fd30-472e-b4e3-c25f855251c5 tempest-VolumeDependencyTests-1872524092 None] Created reservations ['15e1583e-25f3-47f4-9bab-fafb3fac2aaf', '7346b865-ed7c-406c-ab6e-ca2560e4efe1', '43d84be8-5fc0-40f5-9729-c2d30296d902', '129e7647-1f21-4b2e-b4db-df188a70f30b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-32d9c5a2-fd30-472e-b4e3-c25f855251c5 tempest-VolumeDependencyTests-1872524092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-32d9c5a2-fd30-472e-b4e3-c25f855251c5 tempest-VolumeDependencyTests-1872524092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-32d9c5a2-fd30-472e-b4e3-c25f855251c5 tempest-VolumeDependencyTests-1872524092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-32d9c5a2-fd30-472e-b4e3-c25f855251c5 tempest-VolumeDependencyTests-1872524092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-32d9c5a2-fd30-472e-b4e3-c25f855251c5 tempest-VolumeDependencyTests-1872524092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-32d9c5a2-fd30-472e-b4e3-c25f855251c5 tempest-VolumeDependencyTests-1872524092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:43 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-2272bbab-4c11-4089-822b-b0f05c5f301a req-6be0436b-2441-4e93-b0db-2c622ab3bff9 tempest-AttachVolumeNegativeTest-1089741081 None] Terminate volume connection completed successfully. Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-2272bbab-4c11-4089-822b-b0f05c5f301a req-6be0436b-2441-4e93-b0db-2c622ab3bff9 tempest-AttachVolumeNegativeTest-1089741081 None] Deleting attachment bee9bc17-0df2-4cda-b02d-8633b0d44abb. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:36:43 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:36:43 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-729faef9-c943-43a5-b317-e5487a199515 tempest-VolumeDependencyTests-1872524092 None] Acquiring lock "cinder-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-729faef9-c943-43a5-b317-e5487a199515 tempest-VolumeDependencyTests-1872524092 None] Lock "cinder-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:43 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64" returned: 0 in 0.923s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.968s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-729faef9-c943-43a5-b317-e5487a199515 tempest-VolumeDependencyTests-1872524092 None] Acquiring lock "cinder-quobyte-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e21aaab-0091-4be9-b443-70a56e761b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad27d5c3-f0e0-411d-814c-1cdf2fe8dee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-729faef9-c943-43a5-b317-e5487a199515 tempest-VolumeDependencyTests-1872524092 None] Lock "cinder-quobyte-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262" acquired by "delete_volume" :: waited 0.049s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:43 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Volume volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64 (e18d35cc-88d0-4389-b9d3-0b6fb2576c64): created successfully Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad27d5c3-f0e0-411d-814c-1cdf2fe8dee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Flow 'volume_create_manager' (7f2203fc-3e4f-4c67-b038-3780f8c81952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba1b41f-6cc0-41c0-a3c2-554b7949a3af]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-729faef9-c943-43a5-b317-e5487a199515 tempest-VolumeDependencyTests-1872524092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:43 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-602ec16d-8ec8-4a66-b560-0962c9a0f70c tempest-SnapshotsActionsTest-2121408930 None] Created volume successfully. Jul 08 14:36:43 devstack sudo[96743]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_8u38dkszdevstack@QuobyteHD" returned: 0 in 0.988s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] 8a72c3c4-bdc8-4198-ab53-8c7f86124915 was qcow2, converting to raw {{(pid=87240) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 14:36:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_8u38dkszdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:43 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_8u38dkszdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00 Jul 08 14:36:43 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:44 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262 Jul 08 14:36:44 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:44 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-32d9c5a2-fd30-472e-b4e3-c25f855251c5 tempest-VolumeDependencyTests-1872524092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.885s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:44 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-32d9c5a2-fd30-472e-b4e3-c25f855251c5 tempest-VolumeDependencyTests-1872524092 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:36:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-32d9c5a2-fd30-472e-b4e3-c25f855251c5 tempest-VolumeDependencyTests-1872524092 None] Deleted volume successfully. Jul 08 14:36:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-32d9c5a2-fd30-472e-b4e3-c25f855251c5 tempest-VolumeDependencyTests-1872524092 None] Lock "cinder-9f2a44a0-81c9-45f9-9dac-dd6ea11aaaf7-delete_volume" released by "delete_volume" :: held 3.598s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:44 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-729faef9-c943-43a5-b317-e5487a199515 tempest-VolumeDependencyTests-1872524092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262" returned: 0 in 0.999s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-729faef9-c943-43a5-b317-e5487a199515 tempest-VolumeDependencyTests-1872524092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:44 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262 Jul 08 14:36:44 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1329e473-7b26-48f7-9a73-2f7c4a02ebd8 tempest-SnapshotsActionsTest-2121408930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1329e473-7b26-48f7-9a73-2f7c4a02ebd8 tempest-SnapshotsActionsTest-2121408930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-1329e473-7b26-48f7-9a73-2f7c4a02ebd8 tempest-SnapshotsActionsTest-2121408930 None] Creating offline snapshot 49d51b80-d5d7-4b5f-83e3-39fda36765e4 of volume e18d35cc-88d0-4389-b9d3-0b6fb2576c64 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:36:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc2b4fd-0766-4a3c-944e-f6d5b2d2659f]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1329e473-7b26-48f7-9a73-2f7c4a02ebd8 tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:45 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64 Jul 08 14:36:45 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:45 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-729faef9-c943-43a5-b317-e5487a199515 tempest-VolumeDependencyTests-1872524092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262" returned: 0 in 0.967s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-729faef9-c943-43a5-b317-e5487a199515 tempest-VolumeDependencyTests-1872524092 None] Lock "cinder-quobyte-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262" released by "delete_volume" :: held 2.014s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:46 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-729faef9-c943-43a5-b317-e5487a199515 tempest-VolumeDependencyTests-1872524092 None] Created reservations ['926f9720-ffc0-4654-9548-6adca4a410a5', 'bb7e5f0c-b4e2-4f56-8ac7-05f01df0f26c', '4124c4b7-205d-4a55-b6e9-a3f9231f0b27', '5786c29a-fc35-4fcb-aaa0-33aff1d64067'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:36:46 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1329e473-7b26-48f7-9a73-2f7c4a02ebd8 tempest-SnapshotsActionsTest-2121408930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64" returned: 0 in 1.091s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1329e473-7b26-48f7-9a73-2f7c4a02ebd8 tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:46 devstack sudo[96810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 1G Jul 08 14:36:46 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-729faef9-c943-43a5-b317-e5487a199515 tempest-VolumeDependencyTests-1872524092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-729faef9-c943-43a5-b317-e5487a199515 tempest-VolumeDependencyTests-1872524092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-729faef9-c943-43a5-b317-e5487a199515 tempest-VolumeDependencyTests-1872524092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-729faef9-c943-43a5-b317-e5487a199515 tempest-VolumeDependencyTests-1872524092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-729faef9-c943-43a5-b317-e5487a199515 tempest-VolumeDependencyTests-1872524092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-729faef9-c943-43a5-b317-e5487a199515 tempest-VolumeDependencyTests-1872524092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:46 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:36:46 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:46 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_8u38dkszdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00" returned: 0 in 2.574s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:46 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_8u38dkszdevstack@QuobyteHD, size 112.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:36:46 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Converted 112.00 MB image at 43.49 MB/s Jul 08 14:36:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:46 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00 1G Jul 08 14:36:46 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:46 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-729faef9-c943-43a5-b317-e5487a199515 tempest-VolumeDependencyTests-1872524092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.738s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:46 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-729faef9-c943-43a5-b317-e5487a199515 tempest-VolumeDependencyTests-1872524092 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:36:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-729faef9-c943-43a5-b317-e5487a199515 tempest-VolumeDependencyTests-1872524092 None] Deleted volume successfully. Jul 08 14:36:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-729faef9-c943-43a5-b317-e5487a199515 tempest-VolumeDependencyTests-1872524092 None] Lock "cinder-9e84a0e3-9a1e-40fe-adde-c4f2b8ae2262-delete_volume" released by "delete_volume" :: held 3.225s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:47 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1329e473-7b26-48f7-9a73-2f7c4a02ebd8 tempest-SnapshotsActionsTest-2121408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 1G" returned: 0 in 1.116s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1329e473-7b26-48f7-9a73-2f7c4a02ebd8 tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:47 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 Jul 08 14:36:47 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:47 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00 1G" returned: 0 in 0.801s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:47 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a93b538-7e8d-4b62-b60e-15a888e7ff40]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:47 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00 Jul 08 14:36:47 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:48 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1329e473-7b26-48f7-9a73-2f7c4a02ebd8 tempest-SnapshotsActionsTest-2121408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4" returned: 0 in 1.163s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:48 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-1329e473-7b26-48f7-9a73-2f7c4a02ebd8 tempest-SnapshotsActionsTest-2121408930 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 is being set with open permissions: ugo+rw Jul 08 14:36:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1329e473-7b26-48f7-9a73-2f7c4a02ebd8 tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:48 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 Jul 08 14:36:48 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:48 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00" returned: 0 in 1.247s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:48 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00 Jul 08 14:36:48 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:49 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1329e473-7b26-48f7-9a73-2f7c4a02ebd8 tempest-SnapshotsActionsTest-2121408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4" returned: 0 in 0.984s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1329e473-7b26-48f7-9a73-2f7c4a02ebd8 tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:49 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.info Jul 08 14:36:49 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:49 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00" returned: 1 in 1.199s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:36:49 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Downloaded image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 ((None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}])) to volume 2dc15424-9d84-4973-97b2-df177ad84f00 successfully. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 14:36:49 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Temporary image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 for user d8fca737418c4eecb2d5eadf00e24222 is deleted. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 14:36:49 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Marking volume 2dc15424-9d84-4973-97b2-df177ad84f00 as bootable. {{(pid=87240) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 14:36:49 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Copying metadata from image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 to 2dc15424-9d84-4973-97b2-df177ad84f00. {{(pid=87240) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 14:36:49 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Creating volume glance metadata for volume 2dc15424-9d84-4973-97b2-df177ad84f00 backed by image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87240) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 14:36:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d488729-38ae-4f19-a7a4-06740697beec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dc15424-9d84-4973-97b2-df177ad84f00', 'volume_size': 1, 'image_id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f84c09b9fe464edfa51b7a3d44e3b143', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d3d564-4a0b-46b7-8297-a689f46c0bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:49 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Volume volume-2dc15424-9d84-4973-97b2-df177ad84f00 (2dc15424-9d84-4973-97b2-df177ad84f00): created successfully Jul 08 14:36:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d3d564-4a0b-46b7-8297-a689f46c0bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Flow 'volume_create_manager' (945a028e-52a7-4f0e-a7e1-5debce5f2d9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-918611a1-9c4e-40a6-9f20-c22f48ac6e38 tempest-VolumesImageMetadata-209199978 None] Created volume successfully. Jul 08 14:36:50 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1329e473-7b26-48f7-9a73-2f7c4a02ebd8 tempest-SnapshotsActionsTest-2121408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.info" returned: 0 in 0.907s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:50 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-1329e473-7b26-48f7-9a73-2f7c4a02ebd8 tempest-SnapshotsActionsTest-2121408930 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.info is being set with open permissions: ugo+rw Jul 08 14:36:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1329e473-7b26-48f7-9a73-2f7c4a02ebd8 tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:50 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.info Jul 08 14:36:50 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-93f0d548-d63f-4dec-a603-53670c1287b0 tempest-VolumesImageMetadata-209199978 None] Acquiring lock "cinder-2dc15424-9d84-4973-97b2-df177ad84f00-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-93f0d548-d63f-4dec-a603-53670c1287b0 tempest-VolumesImageMetadata-209199978 None] Lock "cinder-2dc15424-9d84-4973-97b2-df177ad84f00-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-93f0d548-d63f-4dec-a603-53670c1287b0 tempest-VolumesImageMetadata-209199978 None] Acquiring lock "cinder-quobyte-2dc15424-9d84-4973-97b2-df177ad84f00" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-93f0d548-d63f-4dec-a603-53670c1287b0 tempest-VolumesImageMetadata-209199978 None] Lock "cinder-quobyte-2dc15424-9d84-4973-97b2-df177ad84f00" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:51 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6790ee74-7937-4213-916d-fc7be722b096]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-93f0d548-d63f-4dec-a603-53670c1287b0 tempest-VolumesImageMetadata-209199978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:51 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1329e473-7b26-48f7-9a73-2f7c4a02ebd8 tempest-SnapshotsActionsTest-2121408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.info" returned: 0 in 0.887s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1329e473-7b26-48f7-9a73-2f7c4a02ebd8 tempest-SnapshotsActionsTest-2121408930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.278s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:51 devstack sudo[96879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00 Jul 08 14:36:51 devstack sudo[96879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:51 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-1329e473-7b26-48f7-9a73-2f7c4a02ebd8 tempest-SnapshotsActionsTest-2121408930 None] Create snapshot completed successfully Jul 08 14:36:51 devstack sudo[96879]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-93f0d548-d63f-4dec-a603-53670c1287b0 tempest-VolumesImageMetadata-209199978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00" returned: 0 in 0.900s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-93f0d548-d63f-4dec-a603-53670c1287b0 tempest-VolumesImageMetadata-209199978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:52 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00 Jul 08 14:36:52 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:52 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-93f0d548-d63f-4dec-a603-53670c1287b0 tempest-VolumesImageMetadata-209199978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00" returned: 1 in 0.953s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-93f0d548-d63f-4dec-a603-53670c1287b0 tempest-VolumesImageMetadata-209199978 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:36:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-93f0d548-d63f-4dec-a603-53670c1287b0 tempest-VolumesImageMetadata-209199978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:52 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00 Jul 08 14:36:52 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b96aba53-306d-4246-b831-0e915d9da2b3 tempest-SnapshotsActionsTest-2121408930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b96aba53-306d-4246-b831-0e915d9da2b3 tempest-SnapshotsActionsTest-2121408930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b96aba53-306d-4246-b831-0e915d9da2b3 tempest-SnapshotsActionsTest-2121408930 None] Creating offline snapshot be223072-3a0a-4652-9eaf-13eade617376 of volume e18d35cc-88d0-4389-b9d3-0b6fb2576c64 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:36:53 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cf8b2e-2aee-41d7-a23d-334f3f6b4459]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b96aba53-306d-4246-b831-0e915d9da2b3 tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:53 devstack sudo[96895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 Jul 08 14:36:53 devstack sudo[96895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:53 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-93f0d548-d63f-4dec-a603-53670c1287b0 tempest-VolumesImageMetadata-209199978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2dc15424-9d84-4973-97b2-df177ad84f00" returned: 0 in 0.957s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-93f0d548-d63f-4dec-a603-53670c1287b0 tempest-VolumesImageMetadata-209199978 None] Lock "cinder-quobyte-2dc15424-9d84-4973-97b2-df177ad84f00" released by "delete_volume" :: held 2.905s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:53 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-93f0d548-d63f-4dec-a603-53670c1287b0 tempest-VolumesImageMetadata-209199978 None] Created reservations ['8ebae115-dd37-4323-949e-048ec28d99ba', 'aca7143c-d7a3-4989-b892-0d6cd88785d7', 'c2bc6d9c-1433-4876-87cc-40e4189e95ab', 'bf860287-6645-42fc-aee7-4bda8aa2db7b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:36:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-93f0d548-d63f-4dec-a603-53670c1287b0 tempest-VolumesImageMetadata-209199978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-93f0d548-d63f-4dec-a603-53670c1287b0 tempest-VolumesImageMetadata-209199978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-93f0d548-d63f-4dec-a603-53670c1287b0 tempest-VolumesImageMetadata-209199978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-93f0d548-d63f-4dec-a603-53670c1287b0 tempest-VolumesImageMetadata-209199978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-93f0d548-d63f-4dec-a603-53670c1287b0 tempest-VolumesImageMetadata-209199978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-93f0d548-d63f-4dec-a603-53670c1287b0 tempest-VolumesImageMetadata-209199978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:54 devstack sudo[96899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:36:54 devstack sudo[96899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:54 devstack sudo[96895]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b96aba53-306d-4246-b831-0e915d9da2b3 tempest-SnapshotsActionsTest-2121408930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4" returned: 0 in 1.031s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b96aba53-306d-4246-b831-0e915d9da2b3 tempest-SnapshotsActionsTest-2121408930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:36:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b96aba53-306d-4246-b831-0e915d9da2b3 tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.be223072-3a0a-4652-9eaf-13eade617376 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:54 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.be223072-3a0a-4652-9eaf-13eade617376 1G Jul 08 14:36:54 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:54 devstack sudo[96899]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-93f0d548-d63f-4dec-a603-53670c1287b0 tempest-VolumesImageMetadata-209199978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.842s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:54 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-93f0d548-d63f-4dec-a603-53670c1287b0 tempest-VolumesImageMetadata-209199978 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:36:54 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-93f0d548-d63f-4dec-a603-53670c1287b0 tempest-VolumesImageMetadata-209199978 None] Deleted volume successfully. Jul 08 14:36:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-93f0d548-d63f-4dec-a603-53670c1287b0 tempest-VolumesImageMetadata-209199978 None] Lock "cinder-2dc15424-9d84-4973-97b2-df177ad84f00-delete_volume" released by "delete_volume" :: held 3.997s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:36:55 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b96aba53-306d-4246-b831-0e915d9da2b3 tempest-SnapshotsActionsTest-2121408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.be223072-3a0a-4652-9eaf-13eade617376 1G" returned: 0 in 1.145s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b96aba53-306d-4246-b831-0e915d9da2b3 tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.be223072-3a0a-4652-9eaf-13eade617376 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:55 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.be223072-3a0a-4652-9eaf-13eade617376 Jul 08 14:36:55 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:56 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b96aba53-306d-4246-b831-0e915d9da2b3 tempest-SnapshotsActionsTest-2121408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.be223072-3a0a-4652-9eaf-13eade617376" returned: 0 in 0.986s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:56 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-b96aba53-306d-4246-b831-0e915d9da2b3 tempest-SnapshotsActionsTest-2121408930 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.be223072-3a0a-4652-9eaf-13eade617376 is being set with open permissions: ugo+rw Jul 08 14:36:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b96aba53-306d-4246-b831-0e915d9da2b3 tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.be223072-3a0a-4652-9eaf-13eade617376 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:56 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.be223072-3a0a-4652-9eaf-13eade617376 Jul 08 14:36:56 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:57 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b96aba53-306d-4246-b831-0e915d9da2b3 tempest-SnapshotsActionsTest-2121408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.be223072-3a0a-4652-9eaf-13eade617376" returned: 0 in 0.836s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b96aba53-306d-4246-b831-0e915d9da2b3 tempest-SnapshotsActionsTest-2121408930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.209s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:57 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b96aba53-306d-4246-b831-0e915d9da2b3 tempest-SnapshotsActionsTest-2121408930 None] Create snapshot completed successfully Jul 08 14:36:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d89e8100-84ed-4810-b762-0ccd92efccbd tempest-SnapshotsActionsTest-1277290238 None] Acquiring lock "cinder-be223072-3a0a-4652-9eaf-13eade617376-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d89e8100-84ed-4810-b762-0ccd92efccbd tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-be223072-3a0a-4652-9eaf-13eade617376-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d89e8100-84ed-4810-b762-0ccd92efccbd tempest-SnapshotsActionsTest-1277290238 None] Acquiring lock "cinder-quobyte-e18d35cc-88d0-4389-b9d3-0b6fb2576c64" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d89e8100-84ed-4810-b762-0ccd92efccbd tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-quobyte-e18d35cc-88d0-4389-b9d3-0b6fb2576c64" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d89e8100-84ed-4810-b762-0ccd92efccbd tempest-SnapshotsActionsTest-1277290238 None] Acquiring lock "cinder-quobyte-be223072-3a0a-4652-9eaf-13eade617376" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:36:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d89e8100-84ed-4810-b762-0ccd92efccbd tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-quobyte-be223072-3a0a-4652-9eaf-13eade617376" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:36:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d89e8100-84ed-4810-b762-0ccd92efccbd tempest-SnapshotsActionsTest-1277290238 None] Deleting offline snapshot be223072-3a0a-4652-9eaf-13eade617376 of volume e18d35cc-88d0-4389-b9d3-0b6fb2576c64 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:36:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d89e8100-84ed-4810-b762-0ccd92efccbd tempest-SnapshotsActionsTest-1277290238 None] snapshot_file for this snap is: volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.be223072-3a0a-4652-9eaf-13eade617376 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:36:58 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ceb323-5499-48be-a54f-ae3c56f30fef]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d89e8100-84ed-4810-b762-0ccd92efccbd tempest-SnapshotsActionsTest-1277290238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.be223072-3a0a-4652-9eaf-13eade617376 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:58 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.be223072-3a0a-4652-9eaf-13eade617376 Jul 08 14:36:58 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Flow 'volume_create_manager' (8f733178-9266-402f-9b5a-fa255e604aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9054389e-547e-4dbf-bf5b-3f411eaa5fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9054389e-547e-4dbf-bf5b-3f411eaa5fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1033791776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd7a43a3-b080-412a-9eeb-3c2868f85142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7e6e52498e4a9f8b077941f557a0ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:59Z,use_quota=True,user_id='3b7aed0c83334701bcf13382845628c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad58ecc3-34f8-4795-a3d3-61abfc626faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad58ecc3-34f8-4795-a3d3-61abfc626faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc7e78b-5deb-42a3-88ae-4b6b70f3f26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dc7e78b-5deb-42a3-88ae-4b6b70f3f26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd7a43a3-b080-412a-9eeb-3c2868f85142', 'volume_name': 'volume-dd7a43a3-b080-412a-9eeb-3c2868f85142', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff5227a-f1ee-4927-8caf-d9c9c980a08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dff5227a-f1ee-4927-8caf-d9c9c980a08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72fd8d90-6e76-497c-886c-86bdb674ebca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:36:59 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Volume dd7a43a3-b080-412a-9eeb-3c2868f85142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd7a43a3-b080-412a-9eeb-3c2868f85142', 'volume_size': 1} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1033791776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd7a43a3-b080-412a-9eeb-3c2868f85142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7e6e52498e4a9f8b077941f557a0ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:36:59Z,use_quota=True,user_id='3b7aed0c83334701bcf13382845628c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Creating volume dd7a43a3-b080-412a-9eeb-3c2868f85142 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:36:59 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dd7a43a3-b080-412a-9eeb-3c2868f85142 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:59 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dd7a43a3-b080-412a-9eeb-3c2868f85142 1073741824 Jul 08 14:36:59 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:59 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:36:59 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:36:59 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d89e8100-84ed-4810-b762-0ccd92efccbd tempest-SnapshotsActionsTest-1277290238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.be223072-3a0a-4652-9eaf-13eade617376" returned: 0 in 1.054s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d89e8100-84ed-4810-b762-0ccd92efccbd tempest-SnapshotsActionsTest-1277290238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5d37d6-d7a6-4bf1-a9d9-0142a0bcf5ba]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:36:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d89e8100-84ed-4810-b762-0ccd92efccbd tempest-SnapshotsActionsTest-1277290238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:36:59 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 Jul 08 14:36:59 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:00 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:37:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Flow 'volume_create_manager' (824ef57f-e84b-4b77-9e1a-26f14b0ddffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e151f05-0fb1-4031-85b1-39e68c5f204d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e151f05-0fb1-4031-85b1-39e68c5f204d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2067440501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa18aede-87a5-4fbc-ba35-b8caaac6e43d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ecf5a2d1d3149a1987f398ff112b041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:00Z,use_quota=True,user_id='ee0e6fb6a4964248ab6f9857008d21dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5157825e-8c2c-4d4c-b537-5a4d7af9aee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5157825e-8c2c-4d4c-b537-5a4d7af9aee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38d2aa9-e690-49fc-a582-e6fe7999cd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c38d2aa9-e690-49fc-a582-e6fe7999cd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa18aede-87a5-4fbc-ba35-b8caaac6e43d', 'volume_name': 'volume-fa18aede-87a5-4fbc-ba35-b8caaac6e43d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a66277c4-2625-4d11-99cf-45f8ab26a88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a66277c4-2625-4d11-99cf-45f8ab26a88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (568c15db-2dbc-4132-8475-3b622e0e6d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:00 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Volume fa18aede-87a5-4fbc-ba35-b8caaac6e43d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa18aede-87a5-4fbc-ba35-b8caaac6e43d', 'volume_size': 1} Jul 08 14:37:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:00 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.034s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:37:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:37:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:37:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:37:00 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dd7a43a3-b080-412a-9eeb-3c2868f85142 1073741824" returned: 0 in 1.413s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dd7a43a3-b080-412a-9eeb-3c2868f85142 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:00 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dd7a43a3-b080-412a-9eeb-3c2868f85142 Jul 08 14:37:00 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:00 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d89e8100-84ed-4810-b762-0ccd92efccbd tempest-SnapshotsActionsTest-1277290238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4" returned: 0 in 1.011s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d89e8100-84ed-4810-b762-0ccd92efccbd tempest-SnapshotsActionsTest-1277290238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:37:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d89e8100-84ed-4810-b762-0ccd92efccbd tempest-SnapshotsActionsTest-1277290238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.be223072-3a0a-4652-9eaf-13eade617376 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:00 devstack sudo[96942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.be223072-3a0a-4652-9eaf-13eade617376 Jul 08 14:37:00 devstack sudo[96942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:01 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dd7a43a3-b080-412a-9eeb-3c2868f85142" returned: 0 in 0.765s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] <== create_volume: return (2233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:37:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.237s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.222s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2067440501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa18aede-87a5-4fbc-ba35-b8caaac6e43d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ecf5a2d1d3149a1987f398ff112b041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:00Z,use_quota=True,user_id='ee0e6fb6a4964248ab6f9857008d21dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:37:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Creating volume fa18aede-87a5-4fbc-ba35-b8caaac6e43d {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:37:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:37:01 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:37:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fa18aede-87a5-4fbc-ba35-b8caaac6e43d 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72fd8d90-6e76-497c-886c-86bdb674ebca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd7a43a3-b080-412a-9eeb-3c2868f85142', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:01 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fa18aede-87a5-4fbc-ba35-b8caaac6e43d 1073741824 Jul 08 14:37:01 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbcf2a0d-189b-4c30-92a5-bb52d1abda0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:01 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Volume volume-dd7a43a3-b080-412a-9eeb-3c2868f85142 (dd7a43a3-b080-412a-9eeb-3c2868f85142): created successfully Jul 08 14:37:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbcf2a0d-189b-4c30-92a5-bb52d1abda0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Flow 'volume_create_manager' (8f733178-9266-402f-9b5a-fa255e604aee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:01 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f0344108-718d-4666-a5c9-dc869d8c4b41 tempest-ProjectReaderTests-1568306586 None] Created volume successfully. Jul 08 14:37:01 devstack sudo[96942]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d89e8100-84ed-4810-b762-0ccd92efccbd tempest-SnapshotsActionsTest-1277290238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.be223072-3a0a-4652-9eaf-13eade617376" returned: 0 in 1.018s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d89e8100-84ed-4810-b762-0ccd92efccbd tempest-SnapshotsActionsTest-1277290238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.be223072-3a0a-4652-9eaf-13eade617376 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:01 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.be223072-3a0a-4652-9eaf-13eade617376 Jul 08 14:37:01 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a87ba3ff-5901-4849-9722-1f0bfd7e6d5b tempest-ProjectReaderTests-1568306586 None] Acquiring lock "cinder-dd7a43a3-b080-412a-9eeb-3c2868f85142-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a87ba3ff-5901-4849-9722-1f0bfd7e6d5b tempest-ProjectReaderTests-1568306586 None] Lock "cinder-dd7a43a3-b080-412a-9eeb-3c2868f85142-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a87ba3ff-5901-4849-9722-1f0bfd7e6d5b tempest-ProjectReaderTests-1568306586 None] Acquiring lock "cinder-quobyte-dd7a43a3-b080-412a-9eeb-3c2868f85142" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a87ba3ff-5901-4849-9722-1f0bfd7e6d5b tempest-ProjectReaderTests-1568306586 None] Lock "cinder-quobyte-dd7a43a3-b080-412a-9eeb-3c2868f85142" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:02 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3640ee-5f7c-4fc9-a8d4-918912b6ad59]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a87ba3ff-5901-4849-9722-1f0bfd7e6d5b tempest-ProjectReaderTests-1568306586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dd7a43a3-b080-412a-9eeb-3c2868f85142 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:02 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fa18aede-87a5-4fbc-ba35-b8caaac6e43d 1073741824" returned: 0 in 1.170s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:02 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d89e8100-84ed-4810-b762-0ccd92efccbd tempest-SnapshotsActionsTest-1277290238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.be223072-3a0a-4652-9eaf-13eade617376" returned: 0 in 0.844s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d89e8100-84ed-4810-b762-0ccd92efccbd tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-quobyte-be223072-3a0a-4652-9eaf-13eade617376" released by "_delete_snapshot" :: held 4.079s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d89e8100-84ed-4810-b762-0ccd92efccbd tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-quobyte-e18d35cc-88d0-4389-b9d3-0b6fb2576c64" released by "delete_snapshot" :: held 4.115s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fa18aede-87a5-4fbc-ba35-b8caaac6e43d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:02 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dd7a43a3-b080-412a-9eeb-3c2868f85142 Jul 08 14:37:02 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:02 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fa18aede-87a5-4fbc-ba35-b8caaac6e43d Jul 08 14:37:02 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:02 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-d89e8100-84ed-4810-b762-0ccd92efccbd tempest-SnapshotsActionsTest-1277290238 None] Created reservations ['223f036c-c4f4-4641-b0dd-707fdf3d249f', '2894d4c1-b2d7-4407-b8ef-9255f8c33bff', 'b52206e5-9594-4dff-909d-3651ca53038c', 'b6ff389d-8db0-4d27-80b0-5bcb6a2cf8a2'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:37:02 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d89e8100-84ed-4810-b762-0ccd92efccbd tempest-SnapshotsActionsTest-1277290238 None] Delete snapshot completed successfully. Jul 08 14:37:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d89e8100-84ed-4810-b762-0ccd92efccbd tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-be223072-3a0a-4652-9eaf-13eade617376-delete_snapshot" released by "delete_snapshot" :: held 4.402s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:03 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fa18aede-87a5-4fbc-ba35-b8caaac6e43d" returned: 0 in 0.779s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:37:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.042s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:03 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (568c15db-2dbc-4132-8475-3b622e0e6d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa18aede-87a5-4fbc-ba35-b8caaac6e43d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7952757f-f2fa-4597-91f8-327a5f7d4cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a87ba3ff-5901-4849-9722-1f0bfd7e6d5b tempest-ProjectReaderTests-1568306586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dd7a43a3-b080-412a-9eeb-3c2868f85142" returned: 0 in 0.935s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a87ba3ff-5901-4849-9722-1f0bfd7e6d5b tempest-ProjectReaderTests-1568306586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dd7a43a3-b080-412a-9eeb-3c2868f85142 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:03 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Volume volume-fa18aede-87a5-4fbc-ba35-b8caaac6e43d (fa18aede-87a5-4fbc-ba35-b8caaac6e43d): created successfully Jul 08 14:37:03 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dd7a43a3-b080-412a-9eeb-3c2868f85142 Jul 08 14:37:03 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7952757f-f2fa-4597-91f8-327a5f7d4cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Flow 'volume_create_manager' (824ef57f-e84b-4b77-9e1a-26f14b0ddffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:03 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f05c1be7-54fd-4477-a03f-9fce15a5772b tempest-AbsoluteLimitsTests-1756610627 None] Created volume successfully. Jul 08 14:37:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dbf3525c-3436-427c-9a10-1f0ef1043e35 tempest-SnapshotsActionsTest-2121408930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dbf3525c-3436-427c-9a10-1f0ef1043e35 tempest-SnapshotsActionsTest-2121408930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:04 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a87ba3ff-5901-4849-9722-1f0bfd7e6d5b tempest-ProjectReaderTests-1568306586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dd7a43a3-b080-412a-9eeb-3c2868f85142" returned: 0 in 0.792s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-dbf3525c-3436-427c-9a10-1f0ef1043e35 tempest-SnapshotsActionsTest-2121408930 None] Creating offline snapshot a4868915-b269-45fb-9ab5-736df41b6356 of volume e18d35cc-88d0-4389-b9d3-0b6fb2576c64 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:37:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a87ba3ff-5901-4849-9722-1f0bfd7e6d5b tempest-ProjectReaderTests-1568306586 None] Lock "cinder-quobyte-dd7a43a3-b080-412a-9eeb-3c2868f85142" released by "delete_volume" :: held 1.816s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:04 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f491adf2-127f-49e6-ab4e-6f626d8e1014]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf3525c-3436-427c-9a10-1f0ef1043e35 tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5751800e-3eaf-416c-bfe0-a9b10a927561 tempest-AbsoluteLimitsTests-1756610627 None] Acquiring lock "cinder-fa18aede-87a5-4fbc-ba35-b8caaac6e43d-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5751800e-3eaf-416c-bfe0-a9b10a927561 tempest-AbsoluteLimitsTests-1756610627 None] Lock "cinder-fa18aede-87a5-4fbc-ba35-b8caaac6e43d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:04 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-a87ba3ff-5901-4849-9722-1f0bfd7e6d5b tempest-ProjectReaderTests-1568306586 None] Created reservations ['124c195d-d4e2-48a1-92e9-8506eba82261', 'f3ab6d6f-3868-4d57-9f03-a7cd4fc04ec8', 'bd2cbd84-7760-4fea-9b7f-a6273aefecd4', 'a7cc5207-a0f5-4dbe-84e2-832397d28faf'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:37:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5751800e-3eaf-416c-bfe0-a9b10a927561 tempest-AbsoluteLimitsTests-1756610627 None] Acquiring lock "cinder-quobyte-fa18aede-87a5-4fbc-ba35-b8caaac6e43d" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5751800e-3eaf-416c-bfe0-a9b10a927561 tempest-AbsoluteLimitsTests-1756610627 None] Lock "cinder-quobyte-fa18aede-87a5-4fbc-ba35-b8caaac6e43d" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:04 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 Jul 08 14:37:04 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:04 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[056517c7-caf5-45f3-8ef9-306d16817275]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5751800e-3eaf-416c-bfe0-a9b10a927561 tempest-AbsoluteLimitsTests-1756610627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fa18aede-87a5-4fbc-ba35-b8caaac6e43d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a87ba3ff-5901-4849-9722-1f0bfd7e6d5b tempest-ProjectReaderTests-1568306586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a87ba3ff-5901-4849-9722-1f0bfd7e6d5b tempest-ProjectReaderTests-1568306586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a87ba3ff-5901-4849-9722-1f0bfd7e6d5b tempest-ProjectReaderTests-1568306586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a87ba3ff-5901-4849-9722-1f0bfd7e6d5b tempest-ProjectReaderTests-1568306586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a87ba3ff-5901-4849-9722-1f0bfd7e6d5b tempest-ProjectReaderTests-1568306586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a87ba3ff-5901-4849-9722-1f0bfd7e6d5b tempest-ProjectReaderTests-1568306586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:04 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:37:04 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:04 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fa18aede-87a5-4fbc-ba35-b8caaac6e43d Jul 08 14:37:04 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:05 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:37:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Flow 'volume_create_manager' (cfc916a5-dbdd-4bad-b1a6-7797fab776a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36385f1-341a-4e55-8c2f-9781cd09072b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f36385f1-341a-4e55-8c2f-9781cd09072b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1664889767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd9d786-6346-4f42-848b-963944dc699a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7e6e52498e4a9f8b077941f557a0ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:05Z,use_quota=True,user_id='3b7aed0c83334701bcf13382845628c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4d504b-959f-4bf7-b6a3-570a39fcd3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4d504b-959f-4bf7-b6a3-570a39fcd3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e612a0-283e-45b9-b4b6-7a423b456005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e612a0-283e-45b9-b4b6-7a423b456005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bd9d786-6346-4f42-848b-963944dc699a', 'volume_name': 'volume-4bd9d786-6346-4f42-848b-963944dc699a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:05 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e99850-07fb-4617-8722-20bc4a391b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e99850-07fb-4617-8722-20bc4a391b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd824c71-41c6-4be6-b246-39187870b380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:05 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Volume 4bd9d786-6346-4f42-848b-963944dc699a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bd9d786-6346-4f42-848b-963944dc699a', 'volume_size': 1} Jul 08 14:37:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf3525c-3436-427c-9a10-1f0ef1043e35 tempest-SnapshotsActionsTest-2121408930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4" returned: 0 in 1.130s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-dbf3525c-3436-427c-9a10-1f0ef1043e35 tempest-SnapshotsActionsTest-2121408930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:37:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf3525c-3436-427c-9a10-1f0ef1043e35 tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.a4868915-b269-45fb-9ab5-736df41b6356 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:05 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a87ba3ff-5901-4849-9722-1f0bfd7e6d5b tempest-ProjectReaderTests-1568306586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.921s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:05 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-a87ba3ff-5901-4849-9722-1f0bfd7e6d5b tempest-ProjectReaderTests-1568306586 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:37:05 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.a4868915-b269-45fb-9ab5-736df41b6356 1G Jul 08 14:37:05 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:05 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a87ba3ff-5901-4849-9722-1f0bfd7e6d5b tempest-ProjectReaderTests-1568306586 None] Deleted volume successfully. Jul 08 14:37:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a87ba3ff-5901-4849-9722-1f0bfd7e6d5b tempest-ProjectReaderTests-1568306586 None] Lock "cinder-dd7a43a3-b080-412a-9eeb-3c2868f85142-delete_volume" released by "delete_volume" :: held 3.116s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:05 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5751800e-3eaf-416c-bfe0-a9b10a927561 tempest-AbsoluteLimitsTests-1756610627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fa18aede-87a5-4fbc-ba35-b8caaac6e43d" returned: 0 in 1.170s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5751800e-3eaf-416c-bfe0-a9b10a927561 tempest-AbsoluteLimitsTests-1756610627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fa18aede-87a5-4fbc-ba35-b8caaac6e43d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:05 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fa18aede-87a5-4fbc-ba35-b8caaac6e43d Jul 08 14:37:05 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:06 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5751800e-3eaf-416c-bfe0-a9b10a927561 tempest-AbsoluteLimitsTests-1756610627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fa18aede-87a5-4fbc-ba35-b8caaac6e43d" returned: 0 in 0.748s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5751800e-3eaf-416c-bfe0-a9b10a927561 tempest-AbsoluteLimitsTests-1756610627 None] Lock "cinder-quobyte-fa18aede-87a5-4fbc-ba35-b8caaac6e43d" released by "delete_volume" :: held 1.974s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:06 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:06 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-5751800e-3eaf-416c-bfe0-a9b10a927561 tempest-AbsoluteLimitsTests-1756610627 None] Created reservations ['1dd15a1c-388c-4ba0-bc32-cb9cb6669bfa', '513c1924-b1f0-4548-bf6f-3a51e95974da', 'ba334465-d72e-40d7-a26b-28b63cb58e11', 'b4167ba6-1c5b-4e17-b391-9ec88135ebf9'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:37:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf3525c-3436-427c-9a10-1f0ef1043e35 tempest-SnapshotsActionsTest-2121408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.a4868915-b269-45fb-9ab5-736df41b6356 1G" returned: 0 in 1.047s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf3525c-3436-427c-9a10-1f0ef1043e35 tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.a4868915-b269-45fb-9ab5-736df41b6356 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:06 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.a4868915-b269-45fb-9ab5-736df41b6356 Jul 08 14:37:06 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5751800e-3eaf-416c-bfe0-a9b10a927561 tempest-AbsoluteLimitsTests-1756610627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5751800e-3eaf-416c-bfe0-a9b10a927561 tempest-AbsoluteLimitsTests-1756610627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5751800e-3eaf-416c-bfe0-a9b10a927561 tempest-AbsoluteLimitsTests-1756610627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5751800e-3eaf-416c-bfe0-a9b10a927561 tempest-AbsoluteLimitsTests-1756610627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5751800e-3eaf-416c-bfe0-a9b10a927561 tempest-AbsoluteLimitsTests-1756610627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5751800e-3eaf-416c-bfe0-a9b10a927561 tempest-AbsoluteLimitsTests-1756610627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:06 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:37:06 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:07 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5751800e-3eaf-416c-bfe0-a9b10a927561 tempest-AbsoluteLimitsTests-1756610627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.101s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:07 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:07 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-5751800e-3eaf-416c-bfe0-a9b10a927561 tempest-AbsoluteLimitsTests-1756610627 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:37:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf3525c-3436-427c-9a10-1f0ef1043e35 tempest-SnapshotsActionsTest-2121408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.a4868915-b269-45fb-9ab5-736df41b6356" returned: 0 in 1.303s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:07 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-dbf3525c-3436-427c-9a10-1f0ef1043e35 tempest-SnapshotsActionsTest-2121408930 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.a4868915-b269-45fb-9ab5-736df41b6356 is being set with open permissions: ugo+rw Jul 08 14:37:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf3525c-3436-427c-9a10-1f0ef1043e35 tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.a4868915-b269-45fb-9ab5-736df41b6356 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5751800e-3eaf-416c-bfe0-a9b10a927561 tempest-AbsoluteLimitsTests-1756610627 None] Deleted volume successfully. Jul 08 14:37:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5751800e-3eaf-416c-bfe0-a9b10a927561 tempest-AbsoluteLimitsTests-1756610627 None] Lock "cinder-fa18aede-87a5-4fbc-ba35-b8caaac6e43d-delete_volume" released by "delete_volume" :: held 3.480s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:07 devstack sudo[97004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.a4868915-b269-45fb-9ab5-736df41b6356 Jul 08 14:37:07 devstack sudo[97004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:08 devstack sudo[97004]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-dbf3525c-3436-427c-9a10-1f0ef1043e35 tempest-SnapshotsActionsTest-2121408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.a4868915-b269-45fb-9ab5-736df41b6356" returned: 0 in 0.855s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-dbf3525c-3436-427c-9a10-1f0ef1043e35 tempest-SnapshotsActionsTest-2121408930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.494s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.280s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1664889767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bd9d786-6346-4f42-848b-963944dc699a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7e6e52498e4a9f8b077941f557a0ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:05Z,use_quota=True,user_id='3b7aed0c83334701bcf13382845628c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:37:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Creating volume 4bd9d786-6346-4f42-848b-963944dc699a {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:37:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:37:08 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:37:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4bd9d786-6346-4f42-848b-963944dc699a 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-dbf3525c-3436-427c-9a10-1f0ef1043e35 tempest-SnapshotsActionsTest-2121408930 None] Create snapshot completed successfully Jul 08 14:37:08 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4bd9d786-6346-4f42-848b-963944dc699a 1073741824 Jul 08 14:37:08 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-59835636-3346-4d7c-9298-00c97ae08cd0 tempest-SnapshotsActionsTest-1277290238 None] Acquiring lock "cinder-a4868915-b269-45fb-9ab5-736df41b6356-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-59835636-3346-4d7c-9298-00c97ae08cd0 tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-a4868915-b269-45fb-9ab5-736df41b6356-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-59835636-3346-4d7c-9298-00c97ae08cd0 tempest-SnapshotsActionsTest-1277290238 None] Acquiring lock "cinder-quobyte-e18d35cc-88d0-4389-b9d3-0b6fb2576c64" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-59835636-3346-4d7c-9298-00c97ae08cd0 tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-quobyte-e18d35cc-88d0-4389-b9d3-0b6fb2576c64" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-59835636-3346-4d7c-9298-00c97ae08cd0 tempest-SnapshotsActionsTest-1277290238 None] Acquiring lock "cinder-quobyte-a4868915-b269-45fb-9ab5-736df41b6356" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-59835636-3346-4d7c-9298-00c97ae08cd0 tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-quobyte-a4868915-b269-45fb-9ab5-736df41b6356" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-59835636-3346-4d7c-9298-00c97ae08cd0 tempest-SnapshotsActionsTest-1277290238 None] Deleting offline snapshot a4868915-b269-45fb-9ab5-736df41b6356 of volume e18d35cc-88d0-4389-b9d3-0b6fb2576c64 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:37:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-59835636-3346-4d7c-9298-00c97ae08cd0 tempest-SnapshotsActionsTest-1277290238 None] snapshot_file for this snap is: volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.a4868915-b269-45fb-9ab5-736df41b6356 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:37:09 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85a1433-8525-4df0-95de-7837b60bbd83]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-59835636-3346-4d7c-9298-00c97ae08cd0 tempest-SnapshotsActionsTest-1277290238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.a4868915-b269-45fb-9ab5-736df41b6356 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:10 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.a4868915-b269-45fb-9ab5-736df41b6356 Jul 08 14:37:10 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:10 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4bd9d786-6346-4f42-848b-963944dc699a 1073741824" returned: 0 in 1.285s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4bd9d786-6346-4f42-848b-963944dc699a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:10 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4bd9d786-6346-4f42-848b-963944dc699a Jul 08 14:37:10 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:10 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-59835636-3346-4d7c-9298-00c97ae08cd0 tempest-SnapshotsActionsTest-1277290238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.a4868915-b269-45fb-9ab5-736df41b6356" returned: 0 in 1.027s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-59835636-3346-4d7c-9298-00c97ae08cd0 tempest-SnapshotsActionsTest-1277290238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:37:10 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7353034f-809d-4c0a-861e-3ce5d1b1fde9]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-59835636-3346-4d7c-9298-00c97ae08cd0 tempest-SnapshotsActionsTest-1277290238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:11 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4bd9d786-6346-4f42-848b-963944dc699a" returned: 0 in 0.847s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] <== create_volume: return (2210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:37:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.214s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd824c71-41c6-4be6-b246-39187870b380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bd9d786-6346-4f42-848b-963944dc699a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:11 devstack sudo[97037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 Jul 08 14:37:11 devstack sudo[97037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51d6a7a-9bd5-4c53-b437-0bc5c6b64ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:11 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Volume volume-4bd9d786-6346-4f42-848b-963944dc699a (4bd9d786-6346-4f42-848b-963944dc699a): created successfully Jul 08 14:37:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51d6a7a-9bd5-4c53-b437-0bc5c6b64ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Flow 'volume_create_manager' (cfc916a5-dbdd-4bad-b1a6-7797fab776a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:11 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5ed1a8eb-13b5-4b6a-9b5a-ab4e9074ba5e tempest-ProjectReaderTests-1568306586 None] Created volume successfully. Jul 08 14:37:11 devstack sudo[97037]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-59835636-3346-4d7c-9298-00c97ae08cd0 tempest-SnapshotsActionsTest-1277290238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4" returned: 0 in 0.957s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-59835636-3346-4d7c-9298-00c97ae08cd0 tempest-SnapshotsActionsTest-1277290238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:37:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-59835636-3346-4d7c-9298-00c97ae08cd0 tempest-SnapshotsActionsTest-1277290238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.a4868915-b269-45fb-9ab5-736df41b6356 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:11 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.a4868915-b269-45fb-9ab5-736df41b6356 Jul 08 14:37:11 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-279db1e1-7c91-4b26-967e-66b5066ff3ce tempest-ProjectReaderTests-1568306586 None] Acquiring lock "cinder-4bd9d786-6346-4f42-848b-963944dc699a-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-279db1e1-7c91-4b26-967e-66b5066ff3ce tempest-ProjectReaderTests-1568306586 None] Lock "cinder-4bd9d786-6346-4f42-848b-963944dc699a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-279db1e1-7c91-4b26-967e-66b5066ff3ce tempest-ProjectReaderTests-1568306586 None] Acquiring lock "cinder-quobyte-4bd9d786-6346-4f42-848b-963944dc699a" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-279db1e1-7c91-4b26-967e-66b5066ff3ce tempest-ProjectReaderTests-1568306586 None] Lock "cinder-quobyte-4bd9d786-6346-4f42-848b-963944dc699a" acquired by "delete_volume" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:12 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7e9cce-4c4e-4cc7-b119-b7c18debe2de]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-279db1e1-7c91-4b26-967e-66b5066ff3ce tempest-ProjectReaderTests-1568306586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4bd9d786-6346-4f42-848b-963944dc699a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:12 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4bd9d786-6346-4f42-848b-963944dc699a Jul 08 14:37:12 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:12 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:37:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Flow 'volume_create_manager' (9ecff1e8-1d51-411e-8ff4-edd74618b9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f3425b-eb39-45a1-b2b8-5b605637fd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2f3425b-eb39-45a1-b2b8-5b605637fd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1536097948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c80e29-716f-4651-ac2b-8201f23bb8b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7841e96cc6240b08ce9e9a51deb1224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:13Z,use_quota=True,user_id='a8b4d0d198e042bfba3e6bf7b56b1775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530e439d-1845-40d5-924a-58c249665a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530e439d-1845-40d5-924a-58c249665a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d462f850-509d-4356-809c-c66ac7a8695e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d462f850-509d-4356-809c-c66ac7a8695e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7c80e29-716f-4651-ac2b-8201f23bb8b8', 'volume_name': 'volume-a7c80e29-716f-4651-ac2b-8201f23bb8b8', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49325c51-f8bf-4d61-bcb0-8a27c0baf78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49325c51-f8bf-4d61-bcb0-8a27c0baf78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:13 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1aaf28-e0ed-4c5e-ad4c-c6cb80c30a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:13 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Volume a7c80e29-716f-4651-ac2b-8201f23bb8b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7c80e29-716f-4651-ac2b-8201f23bb8b8', 'volume_size': 1} Jul 08 14:37:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1536097948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c80e29-716f-4651-ac2b-8201f23bb8b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7841e96cc6240b08ce9e9a51deb1224',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:13Z,use_quota=True,user_id='a8b4d0d198e042bfba3e6bf7b56b1775',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:37:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Creating volume a7c80e29-716f-4651-ac2b-8201f23bb8b8 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:37:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:37:13 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:37:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a7c80e29-716f-4651-ac2b-8201f23bb8b8 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:13 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a7c80e29-716f-4651-ac2b-8201f23bb8b8 1073741824 Jul 08 14:37:13 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:13 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-59835636-3346-4d7c-9298-00c97ae08cd0 tempest-SnapshotsActionsTest-1277290238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.a4868915-b269-45fb-9ab5-736df41b6356" returned: 0 in 1.325s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-59835636-3346-4d7c-9298-00c97ae08cd0 tempest-SnapshotsActionsTest-1277290238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.a4868915-b269-45fb-9ab5-736df41b6356 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:13 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.a4868915-b269-45fb-9ab5-736df41b6356 Jul 08 14:37:13 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:13 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-279db1e1-7c91-4b26-967e-66b5066ff3ce tempest-ProjectReaderTests-1568306586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4bd9d786-6346-4f42-848b-963944dc699a" returned: 0 in 1.212s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-279db1e1-7c91-4b26-967e-66b5066ff3ce tempest-ProjectReaderTests-1568306586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4bd9d786-6346-4f42-848b-963944dc699a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:13 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4bd9d786-6346-4f42-848b-963944dc699a Jul 08 14:37:13 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:14 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a7c80e29-716f-4651-ac2b-8201f23bb8b8 1073741824" returned: 0 in 1.445s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:14 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-59835636-3346-4d7c-9298-00c97ae08cd0 tempest-SnapshotsActionsTest-1277290238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.a4868915-b269-45fb-9ab5-736df41b6356" returned: 0 in 1.276s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:14 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-279db1e1-7c91-4b26-967e-66b5066ff3ce tempest-ProjectReaderTests-1568306586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4bd9d786-6346-4f42-848b-963944dc699a" returned: 0 in 1.174s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-59835636-3346-4d7c-9298-00c97ae08cd0 tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-quobyte-a4868915-b269-45fb-9ab5-736df41b6356" released by "_delete_snapshot" :: held 4.712s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a7c80e29-716f-4651-ac2b-8201f23bb8b8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-279db1e1-7c91-4b26-967e-66b5066ff3ce tempest-ProjectReaderTests-1568306586 None] Lock "cinder-quobyte-4bd9d786-6346-4f42-848b-963944dc699a" released by "delete_volume" :: held 2.474s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-59835636-3346-4d7c-9298-00c97ae08cd0 tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-quobyte-e18d35cc-88d0-4389-b9d3-0b6fb2576c64" released by "delete_snapshot" :: held 4.769s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:14 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a7c80e29-716f-4651-ac2b-8201f23bb8b8 Jul 08 14:37:14 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:14 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-279db1e1-7c91-4b26-967e-66b5066ff3ce tempest-ProjectReaderTests-1568306586 None] Created reservations ['a3487cf9-22db-4875-a818-cd0772f4cb25', '712c48d7-cf4e-4556-bbc8-01114b9433db', 'f5184efa-6ecb-4532-893c-ccd2e611e322', '4d4c02b3-2a60-498b-aa1c-1fad0910257b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:37:14 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-59835636-3346-4d7c-9298-00c97ae08cd0 tempest-SnapshotsActionsTest-1277290238 None] Created reservations ['93ea4519-c31e-4fb3-8ec5-519ddbc6343d', 'b3264e89-c4af-49b9-814f-e416f095d1a5', '573fb26e-64bb-471e-8bc9-f97f5c54421f', 'e797aa66-7434-4acc-a4bc-b80eba39bc62'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:37:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-279db1e1-7c91-4b26-967e-66b5066ff3ce tempest-ProjectReaderTests-1568306586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-279db1e1-7c91-4b26-967e-66b5066ff3ce tempest-ProjectReaderTests-1568306586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-279db1e1-7c91-4b26-967e-66b5066ff3ce tempest-ProjectReaderTests-1568306586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-279db1e1-7c91-4b26-967e-66b5066ff3ce tempest-ProjectReaderTests-1568306586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-279db1e1-7c91-4b26-967e-66b5066ff3ce tempest-ProjectReaderTests-1568306586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-279db1e1-7c91-4b26-967e-66b5066ff3ce tempest-ProjectReaderTests-1568306586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:14 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:37:14 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:14 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-59835636-3346-4d7c-9298-00c97ae08cd0 tempest-SnapshotsActionsTest-1277290238 None] Delete snapshot completed successfully. Jul 08 14:37:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-59835636-3346-4d7c-9298-00c97ae08cd0 tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-a4868915-b269-45fb-9ab5-736df41b6356-delete_snapshot" released by "delete_snapshot" :: held 5.220s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aa81d11e-309c-447d-ade1-30cee3fa477f tempest-SnapshotsActionsTest-2121408930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:15 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a7c80e29-716f-4651-ac2b-8201f23bb8b8" returned: 0 in 1.117s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] <== create_volume: return (2679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:37:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.685s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aa81d11e-309c-447d-ade1-30cee3fa477f tempest-SnapshotsActionsTest-2121408930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.026s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-aa81d11e-309c-447d-ade1-30cee3fa477f tempest-SnapshotsActionsTest-2121408930 None] Creating offline snapshot 75f0e561-2e01-4aa9-a3bc-a4eed9046f57 of volume e18d35cc-88d0-4389-b9d3-0b6fb2576c64 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:37:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1aaf28-e0ed-4c5e-ad4c-c6cb80c30a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7c80e29-716f-4651-ac2b-8201f23bb8b8', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae217bc6-7fa8-48e3-ac47-33b8de0287d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:15 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3271bc-4fe9-40fa-b435-073bc9ba50ec]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa81d11e-309c-447d-ade1-30cee3fa477f tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:15 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Volume volume-a7c80e29-716f-4651-ac2b-8201f23bb8b8 (a7c80e29-716f-4651-ac2b-8201f23bb8b8): created successfully Jul 08 14:37:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae217bc6-7fa8-48e3-ac47-33b8de0287d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Flow 'volume_create_manager' (9ecff1e8-1d51-411e-8ff4-edd74618b9a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:15 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-aa29e13b-d0ff-44e4-b988-4959a0b28be8 tempest-VolumesMetadataTest-392557836 None] Created volume successfully. Jul 08 14:37:16 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-279db1e1-7c91-4b26-967e-66b5066ff3ce tempest-ProjectReaderTests-1568306586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.123s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:16 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-279db1e1-7c91-4b26-967e-66b5066ff3ce tempest-ProjectReaderTests-1568306586 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:37:16 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-279db1e1-7c91-4b26-967e-66b5066ff3ce tempest-ProjectReaderTests-1568306586 None] Deleted volume successfully. Jul 08 14:37:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-279db1e1-7c91-4b26-967e-66b5066ff3ce tempest-ProjectReaderTests-1568306586 None] Lock "cinder-4bd9d786-6346-4f42-848b-963944dc699a-delete_volume" released by "delete_volume" :: held 4.055s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:16 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 Jul 08 14:37:16 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:16 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:37:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Flow 'volume_create_manager' (de154d44-95e4-4221-ac5e-57cd75fe39f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbcca760-8bd9-41df-977a-b657a220166c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbcca760-8bd9-41df-977a-b657a220166c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-699753194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f299de83-d63c-4161-9b71-950f04b11f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7e6e52498e4a9f8b077941f557a0ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:16Z,use_quota=True,user_id='3b7aed0c83334701bcf13382845628c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c0c649-15eb-4188-adef-d1cc0495b386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c0c649-15eb-4188-adef-d1cc0495b386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb4aa9c-df5e-486b-b548-c49a2680ac87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb4aa9c-df5e-486b-b548-c49a2680ac87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f299de83-d63c-4161-9b71-950f04b11f33', 'volume_name': 'volume-f299de83-d63c-4161-9b71-950f04b11f33', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c830f947-b4db-42d4-ab41-97656be5bb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c830f947-b4db-42d4-ab41-97656be5bb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22dd1980-a92c-48f6-8ced-79361338f858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:16 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Volume f299de83-d63c-4161-9b71-950f04b11f33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f299de83-d63c-4161-9b71-950f04b11f33', 'volume_size': 1} Jul 08 14:37:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:17 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa81d11e-309c-447d-ade1-30cee3fa477f tempest-SnapshotsActionsTest-2121408930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4" returned: 0 in 1.399s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-aa81d11e-309c-447d-ade1-30cee3fa477f tempest-SnapshotsActionsTest-2121408930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:37:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa81d11e-309c-447d-ade1-30cee3fa477f tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.75f0e561-2e01-4aa9-a3bc-a4eed9046f57 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:17 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.75f0e561-2e01-4aa9-a3bc-a4eed9046f57 1G Jul 08 14:37:17 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-20e0d4b1-29c8-4cb5-9cb5-3a8f0e7cde36 tempest-VolumesMetadataTest-392557836 None] Acquiring lock "cinder-a7c80e29-716f-4651-ac2b-8201f23bb8b8-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-20e0d4b1-29c8-4cb5-9cb5-3a8f0e7cde36 tempest-VolumesMetadataTest-392557836 None] Lock "cinder-a7c80e29-716f-4651-ac2b-8201f23bb8b8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-20e0d4b1-29c8-4cb5-9cb5-3a8f0e7cde36 tempest-VolumesMetadataTest-392557836 None] Acquiring lock "cinder-quobyte-a7c80e29-716f-4651-ac2b-8201f23bb8b8" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-20e0d4b1-29c8-4cb5-9cb5-3a8f0e7cde36 tempest-VolumesMetadataTest-392557836 None] Lock "cinder-quobyte-a7c80e29-716f-4651-ac2b-8201f23bb8b8" acquired by "delete_volume" :: waited 0.046s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:18 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8121512-5772-4877-9fa0-dc99a0b9d78c]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-20e0d4b1-29c8-4cb5-9cb5-3a8f0e7cde36 tempest-VolumesMetadataTest-392557836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a7c80e29-716f-4651-ac2b-8201f23bb8b8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:18 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a7c80e29-716f-4651-ac2b-8201f23bb8b8 Jul 08 14:37:18 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:18 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa81d11e-309c-447d-ade1-30cee3fa477f tempest-SnapshotsActionsTest-2121408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.75f0e561-2e01-4aa9-a3bc-a4eed9046f57 1G" returned: 0 in 1.307s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa81d11e-309c-447d-ade1-30cee3fa477f tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.75f0e561-2e01-4aa9-a3bc-a4eed9046f57 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:18 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.75f0e561-2e01-4aa9-a3bc-a4eed9046f57 Jul 08 14:37:18 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:19 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-20e0d4b1-29c8-4cb5-9cb5-3a8f0e7cde36 tempest-VolumesMetadataTest-392557836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a7c80e29-716f-4651-ac2b-8201f23bb8b8" returned: 0 in 1.032s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-20e0d4b1-29c8-4cb5-9cb5-3a8f0e7cde36 tempest-VolumesMetadataTest-392557836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a7c80e29-716f-4651-ac2b-8201f23bb8b8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:19 devstack sudo[97159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a7c80e29-716f-4651-ac2b-8201f23bb8b8 Jul 08 14:37:19 devstack sudo[97159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:19 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa81d11e-309c-447d-ade1-30cee3fa477f tempest-SnapshotsActionsTest-2121408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.75f0e561-2e01-4aa9-a3bc-a4eed9046f57" returned: 0 in 1.113s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:19 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-aa81d11e-309c-447d-ade1-30cee3fa477f tempest-SnapshotsActionsTest-2121408930 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.75f0e561-2e01-4aa9-a3bc-a4eed9046f57 is being set with open permissions: ugo+rw Jul 08 14:37:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa81d11e-309c-447d-ade1-30cee3fa477f tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.75f0e561-2e01-4aa9-a3bc-a4eed9046f57 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:19 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.75f0e561-2e01-4aa9-a3bc-a4eed9046f57 Jul 08 14:37:19 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:20 devstack sudo[97159]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-20e0d4b1-29c8-4cb5-9cb5-3a8f0e7cde36 tempest-VolumesMetadataTest-392557836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a7c80e29-716f-4651-ac2b-8201f23bb8b8" returned: 0 in 0.962s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-20e0d4b1-29c8-4cb5-9cb5-3a8f0e7cde36 tempest-VolumesMetadataTest-392557836 None] Lock "cinder-quobyte-a7c80e29-716f-4651-ac2b-8201f23bb8b8" released by "delete_volume" :: held 2.060s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:20 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=109,cinder:UPDATE=113,cinder:INSERT=33,cinder:DELETE=7 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:37:20 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-20e0d4b1-29c8-4cb5-9cb5-3a8f0e7cde36 tempest-VolumesMetadataTest-392557836 None] Created reservations ['713db68e-b278-4588-b888-b110ec34f3de', '8bd73ab7-78d0-4418-84cf-9157aa198bb9', 'd8c63134-f9a8-4b9f-843e-f194515c1e31', '6f82c26f-0a1c-4e3e-bca4-198c16d77241'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:37:20 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa81d11e-309c-447d-ade1-30cee3fa477f tempest-SnapshotsActionsTest-2121408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.75f0e561-2e01-4aa9-a3bc-a4eed9046f57" returned: 0 in 0.814s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aa81d11e-309c-447d-ade1-30cee3fa477f tempest-SnapshotsActionsTest-2121408930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.811s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.957s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-699753194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f299de83-d63c-4161-9b71-950f04b11f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7e6e52498e4a9f8b077941f557a0ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:16Z,use_quota=True,user_id='3b7aed0c83334701bcf13382845628c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:37:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Creating volume f299de83-d63c-4161-9b71-950f04b11f33 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:37:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:37:20 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:37:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f299de83-d63c-4161-9b71-950f04b11f33 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:20 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f299de83-d63c-4161-9b71-950f04b11f33 1073741824 Jul 08 14:37:20 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:20 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-aa81d11e-309c-447d-ade1-30cee3fa477f tempest-SnapshotsActionsTest-2121408930 None] Create snapshot completed successfully Jul 08 14:37:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-20e0d4b1-29c8-4cb5-9cb5-3a8f0e7cde36 tempest-VolumesMetadataTest-392557836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-20e0d4b1-29c8-4cb5-9cb5-3a8f0e7cde36 tempest-VolumesMetadataTest-392557836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-20e0d4b1-29c8-4cb5-9cb5-3a8f0e7cde36 tempest-VolumesMetadataTest-392557836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-20e0d4b1-29c8-4cb5-9cb5-3a8f0e7cde36 tempest-VolumesMetadataTest-392557836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-20e0d4b1-29c8-4cb5-9cb5-3a8f0e7cde36 tempest-VolumesMetadataTest-392557836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-20e0d4b1-29c8-4cb5-9cb5-3a8f0e7cde36 tempest-VolumesMetadataTest-392557836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:20 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:37:20 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ccfe3d33-b7d2-4b81-a667-7abd20d6108f tempest-SnapshotsActionsTest-1277290238 None] Acquiring lock "cinder-75f0e561-2e01-4aa9-a3bc-a4eed9046f57-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ccfe3d33-b7d2-4b81-a667-7abd20d6108f tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-75f0e561-2e01-4aa9-a3bc-a4eed9046f57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ccfe3d33-b7d2-4b81-a667-7abd20d6108f tempest-SnapshotsActionsTest-1277290238 None] Acquiring lock "cinder-quobyte-e18d35cc-88d0-4389-b9d3-0b6fb2576c64" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ccfe3d33-b7d2-4b81-a667-7abd20d6108f tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-quobyte-e18d35cc-88d0-4389-b9d3-0b6fb2576c64" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ccfe3d33-b7d2-4b81-a667-7abd20d6108f tempest-SnapshotsActionsTest-1277290238 None] Acquiring lock "cinder-quobyte-75f0e561-2e01-4aa9-a3bc-a4eed9046f57" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ccfe3d33-b7d2-4b81-a667-7abd20d6108f tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-quobyte-75f0e561-2e01-4aa9-a3bc-a4eed9046f57" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:21 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ccfe3d33-b7d2-4b81-a667-7abd20d6108f tempest-SnapshotsActionsTest-1277290238 None] Deleting offline snapshot 75f0e561-2e01-4aa9-a3bc-a4eed9046f57 of volume e18d35cc-88d0-4389-b9d3-0b6fb2576c64 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:37:21 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ccfe3d33-b7d2-4b81-a667-7abd20d6108f tempest-SnapshotsActionsTest-1277290238 None] snapshot_file for this snap is: volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.75f0e561-2e01-4aa9-a3bc-a4eed9046f57 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:37:21 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b208c5f-4a08-4920-8e82-527ae83417a3]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccfe3d33-b7d2-4b81-a667-7abd20d6108f tempest-SnapshotsActionsTest-1277290238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.75f0e561-2e01-4aa9-a3bc-a4eed9046f57 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:21 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-20e0d4b1-29c8-4cb5-9cb5-3a8f0e7cde36 tempest-VolumesMetadataTest-392557836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.077s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:21 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-20e0d4b1-29c8-4cb5-9cb5-3a8f0e7cde36 tempest-VolumesMetadataTest-392557836 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:37:21 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-20e0d4b1-29c8-4cb5-9cb5-3a8f0e7cde36 tempest-VolumesMetadataTest-392557836 None] Deleted volume successfully. Jul 08 14:37:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-20e0d4b1-29c8-4cb5-9cb5-3a8f0e7cde36 tempest-VolumesMetadataTest-392557836 None] Lock "cinder-a7c80e29-716f-4651-ac2b-8201f23bb8b8-delete_volume" released by "delete_volume" :: held 3.555s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:21 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.75f0e561-2e01-4aa9-a3bc-a4eed9046f57 Jul 08 14:37:21 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:21 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f299de83-d63c-4161-9b71-950f04b11f33 1073741824" returned: 0 in 1.356s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f299de83-d63c-4161-9b71-950f04b11f33 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:22 devstack sudo[97182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f299de83-d63c-4161-9b71-950f04b11f33 Jul 08 14:37:22 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:22 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f299de83-d63c-4161-9b71-950f04b11f33" returned: 0 in 0.930s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] <== create_volume: return (2379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:37:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.387s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:22 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22dd1980-a92c-48f6-8ced-79361338f858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f299de83-d63c-4161-9b71-950f04b11f33', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1006bcc0-5c71-4e81-aae7-1d56950e853b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccfe3d33-b7d2-4b81-a667-7abd20d6108f tempest-SnapshotsActionsTest-1277290238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.75f0e561-2e01-4aa9-a3bc-a4eed9046f57" returned: 0 in 1.337s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ccfe3d33-b7d2-4b81-a667-7abd20d6108f tempest-SnapshotsActionsTest-1277290238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:37:22 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Volume volume-f299de83-d63c-4161-9b71-950f04b11f33 (f299de83-d63c-4161-9b71-950f04b11f33): created successfully Jul 08 14:37:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1006bcc0-5c71-4e81-aae7-1d56950e853b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Flow 'volume_create_manager' (de154d44-95e4-4221-ac5e-57cd75fe39f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:23 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6e672f-c18f-4e55-af64-a808972e127e]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccfe3d33-b7d2-4b81-a667-7abd20d6108f tempest-SnapshotsActionsTest-1277290238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:23 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ce318069-96ac-43f6-86f2-87199e2f97bd tempest-ProjectReaderTests-1568306586 None] Created volume successfully. Jul 08 14:37:23 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 Jul 08 14:37:23 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:24 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccfe3d33-b7d2-4b81-a667-7abd20d6108f tempest-SnapshotsActionsTest-1277290238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4" returned: 0 in 1.028s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ccfe3d33-b7d2-4b81-a667-7abd20d6108f tempest-SnapshotsActionsTest-1277290238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:37:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccfe3d33-b7d2-4b81-a667-7abd20d6108f tempest-SnapshotsActionsTest-1277290238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.75f0e561-2e01-4aa9-a3bc-a4eed9046f57 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:24 devstack sudo[97195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.75f0e561-2e01-4aa9-a3bc-a4eed9046f57 Jul 08 14:37:24 devstack sudo[97195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6538835e-9af0-4432-a15e-e8f86acdedc5 tempest-ProjectReaderTests-1568306586 None] Acquiring lock "cinder-f299de83-d63c-4161-9b71-950f04b11f33-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6538835e-9af0-4432-a15e-e8f86acdedc5 tempest-ProjectReaderTests-1568306586 None] Lock "cinder-f299de83-d63c-4161-9b71-950f04b11f33-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6538835e-9af0-4432-a15e-e8f86acdedc5 tempest-ProjectReaderTests-1568306586 None] Acquiring lock "cinder-quobyte-f299de83-d63c-4161-9b71-950f04b11f33" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6538835e-9af0-4432-a15e-e8f86acdedc5 tempest-ProjectReaderTests-1568306586 None] Lock "cinder-quobyte-f299de83-d63c-4161-9b71-950f04b11f33" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:24 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b514ea-5c0c-4f1a-aebf-9b96c5fc953f]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6538835e-9af0-4432-a15e-e8f86acdedc5 tempest-ProjectReaderTests-1568306586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f299de83-d63c-4161-9b71-950f04b11f33 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:24 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f299de83-d63c-4161-9b71-950f04b11f33 Jul 08 14:37:24 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:25 devstack sudo[97195]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccfe3d33-b7d2-4b81-a667-7abd20d6108f tempest-SnapshotsActionsTest-1277290238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.75f0e561-2e01-4aa9-a3bc-a4eed9046f57" returned: 0 in 1.034s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccfe3d33-b7d2-4b81-a667-7abd20d6108f tempest-SnapshotsActionsTest-1277290238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.75f0e561-2e01-4aa9-a3bc-a4eed9046f57 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:25 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.75f0e561-2e01-4aa9-a3bc-a4eed9046f57 Jul 08 14:37:25 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:25 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6538835e-9af0-4432-a15e-e8f86acdedc5 tempest-ProjectReaderTests-1568306586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f299de83-d63c-4161-9b71-950f04b11f33" returned: 0 in 1.268s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6538835e-9af0-4432-a15e-e8f86acdedc5 tempest-ProjectReaderTests-1568306586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f299de83-d63c-4161-9b71-950f04b11f33 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:25 devstack sudo[97209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f299de83-d63c-4161-9b71-950f04b11f33 Jul 08 14:37:25 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:26 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccfe3d33-b7d2-4b81-a667-7abd20d6108f tempest-SnapshotsActionsTest-1277290238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.75f0e561-2e01-4aa9-a3bc-a4eed9046f57" returned: 0 in 0.952s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ccfe3d33-b7d2-4b81-a667-7abd20d6108f tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-quobyte-75f0e561-2e01-4aa9-a3bc-a4eed9046f57" released by "_delete_snapshot" :: held 4.532s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ccfe3d33-b7d2-4b81-a667-7abd20d6108f tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-quobyte-e18d35cc-88d0-4389-b9d3-0b6fb2576c64" released by "delete_snapshot" :: held 4.575s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:26 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-ccfe3d33-b7d2-4b81-a667-7abd20d6108f tempest-SnapshotsActionsTest-1277290238 None] Created reservations ['15c0964f-b9e5-4860-9c17-130cb73d86dc', 'a977fdef-3cac-492c-9138-41ac3e3bbf95', '96016ca8-66a6-466a-8205-3dcacb26b008', 'ab66d0ff-d0f7-4a20-afe8-598f2eedf0a5'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:37:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ccfe3d33-b7d2-4b81-a667-7abd20d6108f tempest-SnapshotsActionsTest-1277290238 None] Delete snapshot completed successfully. Jul 08 14:37:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ccfe3d33-b7d2-4b81-a667-7abd20d6108f tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-75f0e561-2e01-4aa9-a3bc-a4eed9046f57-delete_snapshot" released by "delete_snapshot" :: held 4.900s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:26 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6538835e-9af0-4432-a15e-e8f86acdedc5 tempest-ProjectReaderTests-1568306586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f299de83-d63c-4161-9b71-950f04b11f33" returned: 0 in 0.931s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6538835e-9af0-4432-a15e-e8f86acdedc5 tempest-ProjectReaderTests-1568306586 None] Lock "cinder-quobyte-f299de83-d63c-4161-9b71-950f04b11f33" released by "delete_volume" :: held 2.248s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:26 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-6538835e-9af0-4432-a15e-e8f86acdedc5 tempest-ProjectReaderTests-1568306586 None] Created reservations ['f8535805-df99-4296-8ab6-a9ca6bf5c161', '6ccd2e8b-bd37-44dc-b6da-6aa2f6e49cfa', '9e5ef530-9c11-48ab-a3ba-ef9ee554a269', '5b9877e6-18bc-4ca7-9468-9ae6f3bac678'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:37:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6538835e-9af0-4432-a15e-e8f86acdedc5 tempest-ProjectReaderTests-1568306586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6538835e-9af0-4432-a15e-e8f86acdedc5 tempest-ProjectReaderTests-1568306586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6538835e-9af0-4432-a15e-e8f86acdedc5 tempest-ProjectReaderTests-1568306586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6538835e-9af0-4432-a15e-e8f86acdedc5 tempest-ProjectReaderTests-1568306586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6538835e-9af0-4432-a15e-e8f86acdedc5 tempest-ProjectReaderTests-1568306586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6538835e-9af0-4432-a15e-e8f86acdedc5 tempest-ProjectReaderTests-1568306586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:26 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:37:26 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5432199d-39de-42bc-acba-07ea3ead9904 tempest-SnapshotsActionsTest-2121408930 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5432199d-39de-42bc-acba-07ea3ead9904 tempest-SnapshotsActionsTest-2121408930 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5432199d-39de-42bc-acba-07ea3ead9904 tempest-SnapshotsActionsTest-2121408930 None] Creating offline snapshot 14e293d4-2a81-4d19-b573-139f3356bf31 of volume e18d35cc-88d0-4389-b9d3-0b6fb2576c64 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:37:27 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c1198b-97b1-4cef-b767-0972c89bd8bc]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5432199d-39de-42bc-acba-07ea3ead9904 tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:27 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 Jul 08 14:37:27 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:27 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6538835e-9af0-4432-a15e-e8f86acdedc5 tempest-ProjectReaderTests-1568306586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.205s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:27 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-6538835e-9af0-4432-a15e-e8f86acdedc5 tempest-ProjectReaderTests-1568306586 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:37:27 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6538835e-9af0-4432-a15e-e8f86acdedc5 tempest-ProjectReaderTests-1568306586 None] Deleted volume successfully. Jul 08 14:37:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6538835e-9af0-4432-a15e-e8f86acdedc5 tempest-ProjectReaderTests-1568306586 None] Lock "cinder-f299de83-d63c-4161-9b71-950f04b11f33-delete_volume" released by "delete_volume" :: held 3.772s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:28 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=112,cinder:INSERT=39,cinder:UPDATE=137,cinder:DELETE=10 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:37:28 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:37:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Flow 'volume_create_manager' (26ac6991-164e-451c-b837-9ef73ac9c230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31557caa-c61e-4184-b5ed-aabb2c081d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31557caa-c61e-4184-b5ed-aabb2c081d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1905074335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabba296-73b5-4dd4-895f-5bb0a7de273a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7e6e52498e4a9f8b077941f557a0ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:28Z,use_quota=True,user_id='3b7aed0c83334701bcf13382845628c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b6f575-639a-4d7e-a71e-f043fa0f2178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b6f575-639a-4d7e-a71e-f043fa0f2178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f7b9ff-9a0c-4584-bc92-d4fe29b7e7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9f7b9ff-9a0c-4584-bc92-d4fe29b7e7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dabba296-73b5-4dd4-895f-5bb0a7de273a', 'volume_name': 'volume-dabba296-73b5-4dd4-895f-5bb0a7de273a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dd55169-ca46-4953-9d32-f96645a9442f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dd55169-ca46-4953-9d32-f96645a9442f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30cad96c-c700-41d3-a2a6-810163cb0b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:28 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Volume dabba296-73b5-4dd4-895f-5bb0a7de273a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dabba296-73b5-4dd4-895f-5bb0a7de273a', 'volume_size': 1} Jul 08 14:37:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:28 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5432199d-39de-42bc-acba-07ea3ead9904 tempest-SnapshotsActionsTest-2121408930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4" returned: 0 in 1.138s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5432199d-39de-42bc-acba-07ea3ead9904 tempest-SnapshotsActionsTest-2121408930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:37:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5432199d-39de-42bc-acba-07ea3ead9904 tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.14e293d4-2a81-4d19-b573-139f3356bf31 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:28 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.14e293d4-2a81-4d19-b573-139f3356bf31 1G Jul 08 14:37:28 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:29 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5432199d-39de-42bc-acba-07ea3ead9904 tempest-SnapshotsActionsTest-2121408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.14e293d4-2a81-4d19-b573-139f3356bf31 1G" returned: 0 in 1.081s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5432199d-39de-42bc-acba-07ea3ead9904 tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.14e293d4-2a81-4d19-b573-139f3356bf31 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:29 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.14e293d4-2a81-4d19-b573-139f3356bf31 Jul 08 14:37:29 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:30 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5432199d-39de-42bc-acba-07ea3ead9904 tempest-SnapshotsActionsTest-2121408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.14e293d4-2a81-4d19-b573-139f3356bf31" returned: 0 in 0.841s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:30 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-5432199d-39de-42bc-acba-07ea3ead9904 tempest-SnapshotsActionsTest-2121408930 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.14e293d4-2a81-4d19-b573-139f3356bf31 is being set with open permissions: ugo+rw Jul 08 14:37:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5432199d-39de-42bc-acba-07ea3ead9904 tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.14e293d4-2a81-4d19-b573-139f3356bf31 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:30 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.14e293d4-2a81-4d19-b573-139f3356bf31 Jul 08 14:37:30 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:31 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5432199d-39de-42bc-acba-07ea3ead9904 tempest-SnapshotsActionsTest-2121408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.14e293d4-2a81-4d19-b573-139f3356bf31" returned: 0 in 0.761s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5432199d-39de-42bc-acba-07ea3ead9904 tempest-SnapshotsActionsTest-2121408930 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.079s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.836s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1905074335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dabba296-73b5-4dd4-895f-5bb0a7de273a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea7e6e52498e4a9f8b077941f557a0ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:28Z,use_quota=True,user_id='3b7aed0c83334701bcf13382845628c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:37:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Creating volume dabba296-73b5-4dd4-895f-5bb0a7de273a {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:37:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:37:31 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:37:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dabba296-73b5-4dd4-895f-5bb0a7de273a 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:31 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dabba296-73b5-4dd4-895f-5bb0a7de273a 1073741824 Jul 08 14:37:31 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:31 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5432199d-39de-42bc-acba-07ea3ead9904 tempest-SnapshotsActionsTest-2121408930 None] Create snapshot completed successfully Jul 08 14:37:32 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dabba296-73b5-4dd4-895f-5bb0a7de273a 1073741824" returned: 0 in 1.063s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dabba296-73b5-4dd4-895f-5bb0a7de273a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:32 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dabba296-73b5-4dd4-895f-5bb0a7de273a Jul 08 14:37:32 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b395303d-88c1-4b94-b8e1-8e5195a96cd0 tempest-SnapshotsActionsTest-1277290238 None] Acquiring lock "cinder-14e293d4-2a81-4d19-b573-139f3356bf31-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b395303d-88c1-4b94-b8e1-8e5195a96cd0 tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-14e293d4-2a81-4d19-b573-139f3356bf31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b395303d-88c1-4b94-b8e1-8e5195a96cd0 tempest-SnapshotsActionsTest-1277290238 None] Acquiring lock "cinder-quobyte-e18d35cc-88d0-4389-b9d3-0b6fb2576c64" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b395303d-88c1-4b94-b8e1-8e5195a96cd0 tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-quobyte-e18d35cc-88d0-4389-b9d3-0b6fb2576c64" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b395303d-88c1-4b94-b8e1-8e5195a96cd0 tempest-SnapshotsActionsTest-1277290238 None] Acquiring lock "cinder-quobyte-14e293d4-2a81-4d19-b573-139f3356bf31" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b395303d-88c1-4b94-b8e1-8e5195a96cd0 tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-quobyte-14e293d4-2a81-4d19-b573-139f3356bf31" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b395303d-88c1-4b94-b8e1-8e5195a96cd0 tempest-SnapshotsActionsTest-1277290238 None] Deleting offline snapshot 14e293d4-2a81-4d19-b573-139f3356bf31 of volume e18d35cc-88d0-4389-b9d3-0b6fb2576c64 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:37:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b395303d-88c1-4b94-b8e1-8e5195a96cd0 tempest-SnapshotsActionsTest-1277290238 None] snapshot_file for this snap is: volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.14e293d4-2a81-4d19-b573-139f3356bf31 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:37:32 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e179e4dd-4379-4643-bd11-0f8980e94bcc]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b395303d-88c1-4b94-b8e1-8e5195a96cd0 tempest-SnapshotsActionsTest-1277290238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.14e293d4-2a81-4d19-b573-139f3356bf31 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:33 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.14e293d4-2a81-4d19-b573-139f3356bf31 Jul 08 14:37:33 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:33 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dabba296-73b5-4dd4-895f-5bb0a7de273a" returned: 0 in 0.853s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] <== create_volume: return (1993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:37:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30cad96c-c700-41d3-a2a6-810163cb0b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dabba296-73b5-4dd4-895f-5bb0a7de273a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff27139-246f-49e7-9e4b-8993e82a6b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:33 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Volume volume-dabba296-73b5-4dd4-895f-5bb0a7de273a (dabba296-73b5-4dd4-895f-5bb0a7de273a): created successfully Jul 08 14:37:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff27139-246f-49e7-9e4b-8993e82a6b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:33 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Flow 'volume_create_manager' (26ac6991-164e-451c-b837-9ef73ac9c230) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:33 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7c6b8ae0-e7bd-4e4c-a81a-abdede3c3d21 tempest-ProjectReaderTests-1568306586 None] Created volume successfully. Jul 08 14:37:33 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b395303d-88c1-4b94-b8e1-8e5195a96cd0 tempest-SnapshotsActionsTest-1277290238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.14e293d4-2a81-4d19-b573-139f3356bf31" returned: 0 in 1.038s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b395303d-88c1-4b94-b8e1-8e5195a96cd0 tempest-SnapshotsActionsTest-1277290238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:37:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-26b9550f-80e2-4cee-9d1d-bbb3f593a2e9 tempest-ProjectReaderTests-1568306586 None] Acquiring lock "cinder-dabba296-73b5-4dd4-895f-5bb0a7de273a-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:34 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[652ce6f0-37ad-40b3-b170-de95533cb997]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b395303d-88c1-4b94-b8e1-8e5195a96cd0 tempest-SnapshotsActionsTest-1277290238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-26b9550f-80e2-4cee-9d1d-bbb3f593a2e9 tempest-ProjectReaderTests-1568306586 None] Lock "cinder-dabba296-73b5-4dd4-895f-5bb0a7de273a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-26b9550f-80e2-4cee-9d1d-bbb3f593a2e9 tempest-ProjectReaderTests-1568306586 None] Acquiring lock "cinder-quobyte-dabba296-73b5-4dd4-895f-5bb0a7de273a" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:34 devstack sudo[97271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 Jul 08 14:37:34 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-26b9550f-80e2-4cee-9d1d-bbb3f593a2e9 tempest-ProjectReaderTests-1568306586 None] Lock "cinder-quobyte-dabba296-73b5-4dd4-895f-5bb0a7de273a" acquired by "delete_volume" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:34 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b947f5-7236-4605-9d73-f0851b304ac7]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26b9550f-80e2-4cee-9d1d-bbb3f593a2e9 tempest-ProjectReaderTests-1568306586 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dabba296-73b5-4dd4-895f-5bb0a7de273a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:34 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dabba296-73b5-4dd4-895f-5bb0a7de273a Jul 08 14:37:34 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:35 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b395303d-88c1-4b94-b8e1-8e5195a96cd0 tempest-SnapshotsActionsTest-1277290238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4" returned: 0 in 1.211s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b395303d-88c1-4b94-b8e1-8e5195a96cd0 tempest-SnapshotsActionsTest-1277290238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:37:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b395303d-88c1-4b94-b8e1-8e5195a96cd0 tempest-SnapshotsActionsTest-1277290238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.14e293d4-2a81-4d19-b573-139f3356bf31 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:35 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26b9550f-80e2-4cee-9d1d-bbb3f593a2e9 tempest-ProjectReaderTests-1568306586 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dabba296-73b5-4dd4-895f-5bb0a7de273a" returned: 0 in 1.054s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26b9550f-80e2-4cee-9d1d-bbb3f593a2e9 tempest-ProjectReaderTests-1568306586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dabba296-73b5-4dd4-895f-5bb0a7de273a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:35 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.14e293d4-2a81-4d19-b573-139f3356bf31 Jul 08 14:37:35 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:35 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dabba296-73b5-4dd4-895f-5bb0a7de273a Jul 08 14:37:35 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:36 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26b9550f-80e2-4cee-9d1d-bbb3f593a2e9 tempest-ProjectReaderTests-1568306586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-dabba296-73b5-4dd4-895f-5bb0a7de273a" returned: 0 in 0.974s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-26b9550f-80e2-4cee-9d1d-bbb3f593a2e9 tempest-ProjectReaderTests-1568306586 None] Lock "cinder-quobyte-dabba296-73b5-4dd4-895f-5bb0a7de273a" released by "delete_volume" :: held 2.088s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:36 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-26b9550f-80e2-4cee-9d1d-bbb3f593a2e9 tempest-ProjectReaderTests-1568306586 None] Created reservations ['c25a5bf2-b114-4802-8041-2f34effb7d7e', '9aa5a6e4-d620-4de2-9986-d04b68c65a9e', 'acc212ba-1a23-4034-9c3e-65222a1d15d8', 'b5242446-65de-4dac-a840-a6b338404bf6'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:37:36 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b395303d-88c1-4b94-b8e1-8e5195a96cd0 tempest-SnapshotsActionsTest-1277290238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.14e293d4-2a81-4d19-b573-139f3356bf31" returned: 0 in 1.191s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b395303d-88c1-4b94-b8e1-8e5195a96cd0 tempest-SnapshotsActionsTest-1277290238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.14e293d4-2a81-4d19-b573-139f3356bf31 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-26b9550f-80e2-4cee-9d1d-bbb3f593a2e9 tempest-ProjectReaderTests-1568306586 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-26b9550f-80e2-4cee-9d1d-bbb3f593a2e9 tempest-ProjectReaderTests-1568306586 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-26b9550f-80e2-4cee-9d1d-bbb3f593a2e9 tempest-ProjectReaderTests-1568306586 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:36 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.14e293d4-2a81-4d19-b573-139f3356bf31 Jul 08 14:37:36 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-26b9550f-80e2-4cee-9d1d-bbb3f593a2e9 tempest-ProjectReaderTests-1568306586 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-26b9550f-80e2-4cee-9d1d-bbb3f593a2e9 tempest-ProjectReaderTests-1568306586 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26b9550f-80e2-4cee-9d1d-bbb3f593a2e9 tempest-ProjectReaderTests-1568306586 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:36 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:37:36 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:37 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26b9550f-80e2-4cee-9d1d-bbb3f593a2e9 tempest-ProjectReaderTests-1568306586 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.966s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:37 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-26b9550f-80e2-4cee-9d1d-bbb3f593a2e9 tempest-ProjectReaderTests-1568306586 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:37:37 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-26b9550f-80e2-4cee-9d1d-bbb3f593a2e9 tempest-ProjectReaderTests-1568306586 None] Deleted volume successfully. Jul 08 14:37:37 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-26b9550f-80e2-4cee-9d1d-bbb3f593a2e9 tempest-ProjectReaderTests-1568306586 None] Lock "cinder-dabba296-73b5-4dd4-895f-5bb0a7de273a-delete_volume" released by "delete_volume" :: held 3.437s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b395303d-88c1-4b94-b8e1-8e5195a96cd0 tempest-SnapshotsActionsTest-1277290238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.14e293d4-2a81-4d19-b573-139f3356bf31" returned: 0 in 1.082s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b395303d-88c1-4b94-b8e1-8e5195a96cd0 tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-quobyte-14e293d4-2a81-4d19-b573-139f3356bf31" released by "_delete_snapshot" :: held 4.690s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b395303d-88c1-4b94-b8e1-8e5195a96cd0 tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-quobyte-e18d35cc-88d0-4389-b9d3-0b6fb2576c64" released by "delete_snapshot" :: held 4.753s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:37 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-b395303d-88c1-4b94-b8e1-8e5195a96cd0 tempest-SnapshotsActionsTest-1277290238 None] Created reservations ['03c7239c-4225-4725-a9d5-07dcea2c55fc', '226930f8-451e-488f-a712-f7ec20db9795', '01513160-1e59-4b50-aca1-b0685498fc01', '00f75e99-b4ff-4e94-9b37-9c6f3e6540fa'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:37:37 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b395303d-88c1-4b94-b8e1-8e5195a96cd0 tempest-SnapshotsActionsTest-1277290238 None] Delete snapshot completed successfully. Jul 08 14:37:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b395303d-88c1-4b94-b8e1-8e5195a96cd0 tempest-SnapshotsActionsTest-1277290238 None] Lock "cinder-14e293d4-2a81-4d19-b573-139f3356bf31-delete_snapshot" released by "delete_snapshot" :: held 5.042s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e998ac8c-8ada-4a27-b67c-dedf70eed6bd tempest-SnapshotsActionsTest-2121408930 None] Acquiring lock "cinder-49d51b80-d5d7-4b5f-83e3-39fda36765e4-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e998ac8c-8ada-4a27-b67c-dedf70eed6bd tempest-SnapshotsActionsTest-2121408930 None] Lock "cinder-49d51b80-d5d7-4b5f-83e3-39fda36765e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e998ac8c-8ada-4a27-b67c-dedf70eed6bd tempest-SnapshotsActionsTest-2121408930 None] Acquiring lock "cinder-quobyte-e18d35cc-88d0-4389-b9d3-0b6fb2576c64" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e998ac8c-8ada-4a27-b67c-dedf70eed6bd tempest-SnapshotsActionsTest-2121408930 None] Lock "cinder-quobyte-e18d35cc-88d0-4389-b9d3-0b6fb2576c64" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e998ac8c-8ada-4a27-b67c-dedf70eed6bd tempest-SnapshotsActionsTest-2121408930 None] Acquiring lock "cinder-quobyte-49d51b80-d5d7-4b5f-83e3-39fda36765e4" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e998ac8c-8ada-4a27-b67c-dedf70eed6bd tempest-SnapshotsActionsTest-2121408930 None] Lock "cinder-quobyte-49d51b80-d5d7-4b5f-83e3-39fda36765e4" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e998ac8c-8ada-4a27-b67c-dedf70eed6bd tempest-SnapshotsActionsTest-2121408930 None] Deleting offline snapshot 49d51b80-d5d7-4b5f-83e3-39fda36765e4 of volume e18d35cc-88d0-4389-b9d3-0b6fb2576c64 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:37:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e998ac8c-8ada-4a27-b67c-dedf70eed6bd tempest-SnapshotsActionsTest-2121408930 None] snapshot_file for this snap is: volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:37:38 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ddcfe30-5f5f-4e39-a9ca-2a5b511eb0eb]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e998ac8c-8ada-4a27-b67c-dedf70eed6bd tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:38 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 Jul 08 14:37:38 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Flow 'volume_create_manager' (7307074e-77ad-4c2d-a48c-e46dee1fcca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f355c5-138f-4313-9b22-4da527d9b954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f355c5-138f-4313-9b22-4da527d9b954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1389443762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6731ffca-0d0c-4980-8268-337ec90c5633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='071d3c96940d4b52bd60f99ba7d25812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:39Z,use_quota=True,user_id='e3ac979667194b7c9c71358603b3402a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23434a47-e80d-4449-bb0d-dadfd0d2d338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23434a47-e80d-4449-bb0d-dadfd0d2d338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a02ade-9661-4e55-b8c8-60941455b98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a02ade-9661-4e55-b8c8-60941455b98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6731ffca-0d0c-4980-8268-337ec90c5633', 'volume_name': 'volume-6731ffca-0d0c-4980-8268-337ec90c5633', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c321653-95be-474f-86ab-c46b011550d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c321653-95be-474f-86ab-c46b011550d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df24e2ed-91c7-42e0-b7bf-62c782ebbd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:39 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Volume 6731ffca-0d0c-4980-8268-337ec90c5633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6731ffca-0d0c-4980-8268-337ec90c5633', 'volume_size': 1} Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1389443762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6731ffca-0d0c-4980-8268-337ec90c5633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='071d3c96940d4b52bd60f99ba7d25812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:39Z,use_quota=True,user_id='e3ac979667194b7c9c71358603b3402a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Creating volume 6731ffca-0d0c-4980-8268-337ec90c5633 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:37:39 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:39 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 1073741824 Jul 08 14:37:39 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:39 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e998ac8c-8ada-4a27-b67c-dedf70eed6bd tempest-SnapshotsActionsTest-2121408930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4" returned: 0 in 1.099s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e998ac8c-8ada-4a27-b67c-dedf70eed6bd tempest-SnapshotsActionsTest-2121408930 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7bedc7-f750-444f-926e-579dc4bfd9ab]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e998ac8c-8ada-4a27-b67c-dedf70eed6bd tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:40 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64 Jul 08 14:37:40 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:40 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:37:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Flow 'volume_create_manager' (c15a0235-4880-45c8-909f-9ed0da93a1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92098d24-3b9c-467a-aa2a-1de64db22f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92098d24-3b9c-467a-aa2a-1de64db22f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-256995212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aac15bb-1a87-4cff-9738-b9ffe5515107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48e5053ea594cb8b8007ac72a44f4c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:41Z,use_quota=True,user_id='19d1a5694f174a8aa027528642e4ef2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78fb2d85-bc27-4ce4-92a1-69e06c2da5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78fb2d85-bc27-4ce4-92a1-69e06c2da5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5044ddc3-ec41-437e-8a5b-e6df3db711f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5044ddc3-ec41-437e-8a5b-e6df3db711f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3aac15bb-1a87-4cff-9738-b9ffe5515107', 'volume_name': 'volume-3aac15bb-1a87-4cff-9738-b9ffe5515107', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329b210e-d81c-4009-a718-6332952f3493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329b210e-d81c-4009-a718-6332952f3493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee14d380-ce32-48c7-9903-8d30f896dcbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:40 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Volume 3aac15bb-1a87-4cff-9738-b9ffe5515107: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3aac15bb-1a87-4cff-9738-b9ffe5515107', 'volume_size': 1} Jul 08 14:37:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:40 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 1073741824" returned: 0 in 1.214s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:40 devstack sudo[97315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 Jul 08 14:37:40 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:40 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e998ac8c-8ada-4a27-b67c-dedf70eed6bd tempest-SnapshotsActionsTest-2121408930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64" returned: 0 in 1.019s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e998ac8c-8ada-4a27-b67c-dedf70eed6bd tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:40 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 Jul 08 14:37:40 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:41 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633" returned: 0 in 0.868s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] <== create_volume: return (2154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:37:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.163s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.981s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:37:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-256995212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3aac15bb-1a87-4cff-9738-b9ffe5515107,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f48e5053ea594cb8b8007ac72a44f4c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:37:41Z,use_quota=True,user_id='19d1a5694f174a8aa027528642e4ef2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:37:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Creating volume 3aac15bb-1a87-4cff-9738-b9ffe5515107 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:37:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:37:41 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:37:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3aac15bb-1a87-4cff-9738-b9ffe5515107 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:41 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3aac15bb-1a87-4cff-9738-b9ffe5515107 1073741824 Jul 08 14:37:41 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df24e2ed-91c7-42e0-b7bf-62c782ebbd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6731ffca-0d0c-4980-8268-337ec90c5633', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1582e5a-3801-40d9-9e92-e0910c086634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:41 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Volume volume-6731ffca-0d0c-4980-8268-337ec90c5633 (6731ffca-0d0c-4980-8268-337ec90c5633): created successfully Jul 08 14:37:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1582e5a-3801-40d9-9e92-e0910c086634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Flow 'volume_create_manager' (7307074e-77ad-4c2d-a48c-e46dee1fcca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:41 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bef647a6-67f2-45b1-b62e-234253ebe411 tempest-VolumesActionsTest-843130989 None] Created volume successfully. Jul 08 14:37:41 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e998ac8c-8ada-4a27-b67c-dedf70eed6bd tempest-SnapshotsActionsTest-2121408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4" returned: 0 in 0.992s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e998ac8c-8ada-4a27-b67c-dedf70eed6bd tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:41 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4 Jul 08 14:37:41 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:42 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e998ac8c-8ada-4a27-b67c-dedf70eed6bd tempest-SnapshotsActionsTest-2121408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64.49d51b80-d5d7-4b5f-83e3-39fda36765e4" returned: 0 in 0.985s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e998ac8c-8ada-4a27-b67c-dedf70eed6bd tempest-SnapshotsActionsTest-2121408930 None] Lock "cinder-quobyte-49d51b80-d5d7-4b5f-83e3-39fda36765e4" released by "_delete_snapshot" :: held 4.282s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e998ac8c-8ada-4a27-b67c-dedf70eed6bd tempest-SnapshotsActionsTest-2121408930 None] Lock "cinder-quobyte-e18d35cc-88d0-4389-b9d3-0b6fb2576c64" released by "delete_snapshot" :: held 4.322s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:43 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3aac15bb-1a87-4cff-9738-b9ffe5515107 1073741824" returned: 0 in 1.367s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:43 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-e998ac8c-8ada-4a27-b67c-dedf70eed6bd tempest-SnapshotsActionsTest-2121408930 None] Created reservations ['42b5e35f-5548-49a7-be9f-396195d526b3', '12405527-0570-4db3-ba1d-0c47d54c4445', 'e4390181-96c5-42c7-a68a-ae9c4fb83616', 'af8ddd4a-678c-40c7-9787-3cf9478a8d68'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:37:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3aac15bb-1a87-4cff-9738-b9ffe5515107 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:43 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3aac15bb-1a87-4cff-9738-b9ffe5515107 Jul 08 14:37:43 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:43 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e998ac8c-8ada-4a27-b67c-dedf70eed6bd tempest-SnapshotsActionsTest-2121408930 None] Delete snapshot completed successfully. Jul 08 14:37:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e998ac8c-8ada-4a27-b67c-dedf70eed6bd tempest-SnapshotsActionsTest-2121408930 None] Lock "cinder-49d51b80-d5d7-4b5f-83e3-39fda36765e4-delete_snapshot" released by "delete_snapshot" :: held 4.628s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:44 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3aac15bb-1a87-4cff-9738-b9ffe5515107" returned: 0 in 0.854s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] <== create_volume: return (2309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:37:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.313s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee14d380-ce32-48c7-9903-8d30f896dcbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3aac15bb-1a87-4cff-9738-b9ffe5515107', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7050d8-e697-4b04-b188-9cda158cc403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:37:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e32e1cbb-2a34-40a6-9521-2037acb8d368 tempest-SnapshotsActionsTest-2121408930 None] Acquiring lock "cinder-e18d35cc-88d0-4389-b9d3-0b6fb2576c64-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:44 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Volume volume-3aac15bb-1a87-4cff-9738-b9ffe5515107 (3aac15bb-1a87-4cff-9738-b9ffe5515107): created successfully Jul 08 14:37:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7050d8-e697-4b04-b188-9cda158cc403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:37:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Flow 'volume_create_manager' (c15a0235-4880-45c8-909f-9ed0da93a1ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:37:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e32e1cbb-2a34-40a6-9521-2037acb8d368 tempest-SnapshotsActionsTest-2121408930 None] Lock "cinder-e18d35cc-88d0-4389-b9d3-0b6fb2576c64-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f3616d56-9bd4-4ea5-9f73-43fd76748a7f tempest-AttachVolumeNegativeTest-1089741081 None] Created volume successfully. Jul 08 14:37:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e32e1cbb-2a34-40a6-9521-2037acb8d368 tempest-SnapshotsActionsTest-2121408930 None] Acquiring lock "cinder-quobyte-e18d35cc-88d0-4389-b9d3-0b6fb2576c64" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:37:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e32e1cbb-2a34-40a6-9521-2037acb8d368 tempest-SnapshotsActionsTest-2121408930 None] Lock "cinder-quobyte-e18d35cc-88d0-4389-b9d3-0b6fb2576c64" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:37:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fc84a7-8a62-4b1f-8852-773f054e4683]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e32e1cbb-2a34-40a6-9521-2037acb8d368 tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:44 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64 Jul 08 14:37:44 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:45 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e32e1cbb-2a34-40a6-9521-2037acb8d368 tempest-SnapshotsActionsTest-2121408930 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64" returned: 0 in 1.105s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e32e1cbb-2a34-40a6-9521-2037acb8d368 tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:45 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64 Jul 08 14:37:45 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:46 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e32e1cbb-2a34-40a6-9521-2037acb8d368 tempest-SnapshotsActionsTest-2121408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e18d35cc-88d0-4389-b9d3-0b6fb2576c64" returned: 0 in 0.821s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e32e1cbb-2a34-40a6-9521-2037acb8d368 tempest-SnapshotsActionsTest-2121408930 None] Lock "cinder-quobyte-e18d35cc-88d0-4389-b9d3-0b6fb2576c64" released by "delete_volume" :: held 2.012s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:46 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-e32e1cbb-2a34-40a6-9521-2037acb8d368 tempest-SnapshotsActionsTest-2121408930 None] Created reservations ['80cb81af-9c5d-4d42-9bd1-fb0c8725f3ec', 'a5c92a25-2c9f-4be7-a488-a1a182077a45', 'ea2b616b-2c23-4bc7-afc6-b4cad8d07d6f', '03024ca5-cc7a-4e98-885f-22ade8fda1c1'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:37:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e32e1cbb-2a34-40a6-9521-2037acb8d368 tempest-SnapshotsActionsTest-2121408930 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e32e1cbb-2a34-40a6-9521-2037acb8d368 tempest-SnapshotsActionsTest-2121408930 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e32e1cbb-2a34-40a6-9521-2037acb8d368 tempest-SnapshotsActionsTest-2121408930 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e32e1cbb-2a34-40a6-9521-2037acb8d368 tempest-SnapshotsActionsTest-2121408930 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e32e1cbb-2a34-40a6-9521-2037acb8d368 tempest-SnapshotsActionsTest-2121408930 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e32e1cbb-2a34-40a6-9521-2037acb8d368 tempest-SnapshotsActionsTest-2121408930 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:46 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:37:46 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:47 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e32e1cbb-2a34-40a6-9521-2037acb8d368 tempest-SnapshotsActionsTest-2121408930 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.730s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:47 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-e32e1cbb-2a34-40a6-9521-2037acb8d368 tempest-SnapshotsActionsTest-2121408930 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:37:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e32e1cbb-2a34-40a6-9521-2037acb8d368 tempest-SnapshotsActionsTest-2121408930 None] Deleted volume successfully. Jul 08 14:37:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e32e1cbb-2a34-40a6-9521-2037acb8d368 tempest-SnapshotsActionsTest-2121408930 None] Lock "cinder-e18d35cc-88d0-4389-b9d3-0b6fb2576c64-delete_volume" released by "delete_volume" :: held 3.057s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:37:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-594bc8e2-ca3e-4898-b766-e667c866ccde req-e506cda5-08d4-41c7-a49b-d511151a62dc tempest-AttachVolumeNegativeTest-1089741081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-594bc8e2-ca3e-4898-b766-e667c866ccde req-e506cda5-08d4-41c7-a49b-d511151a62dc tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:48 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c3c8f8-e532-4b86-9493-f3374ea96be4]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:37:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-594bc8e2-ca3e-4898-b766-e667c866ccde req-e506cda5-08d4-41c7-a49b-d511151a62dc tempest-AttachVolumeNegativeTest-1089741081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3aac15bb-1a87-4cff-9738-b9ffe5515107 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:48 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3aac15bb-1a87-4cff-9738-b9ffe5515107 Jul 08 14:37:48 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:37:49 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Jul 08 14:37:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-594bc8e2-ca3e-4898-b766-e667c866ccde req-e506cda5-08d4-41c7-a49b-d511151a62dc tempest-AttachVolumeNegativeTest-1089741081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3aac15bb-1a87-4cff-9738-b9ffe5515107" returned: 0 in 1.256s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:37:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-594bc8e2-ca3e-4898-b766-e667c866ccde req-e506cda5-08d4-41c7-a49b-d511151a62dc tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.300s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-594bc8e2-ca3e-4898-b766-e667c866ccde req-e506cda5-08d4-41c7-a49b-d511151a62dc tempest-AttachVolumeNegativeTest-1089741081 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad', 'name': 'volume-3aac15bb-1a87-4cff-9738-b9ffe5515107', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5cfc2457-bef1-4ad1-9217-654b399f82ed', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:37:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-594bc8e2-ca3e-4898-b766-e667c866ccde req-e506cda5-08d4-41c7-a49b-d511151a62dc tempest-AttachVolumeNegativeTest-1089741081 None] attachment_update completed successfully. Jul 08 14:37:57 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-c385e20d-f747-4301-86d4-e0df6fcb4dc9 req-75b03d5c-88df-4c44-bd56-fbc656ae912e tempest-AttachVolumeNegativeTest-1089741081 None] Terminate volume connection completed successfully. Jul 08 14:37:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-c385e20d-f747-4301-86d4-e0df6fcb4dc9 req-75b03d5c-88df-4c44-bd56-fbc656ae912e tempest-AttachVolumeNegativeTest-1089741081 None] Deleting attachment 5cfc2457-bef1-4ad1-9217-654b399f82ed. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:37:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:37:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:37:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:37:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:37:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:37:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:37:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:37:59 devstack sudo[97848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:37:59 devstack sudo[97848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:00 devstack sudo[97848]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.140s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:38:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:38:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:38:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:38:07 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=50,cinder:INSERT=15,cinder:UPDATE=57,cinder:DELETE=5 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:38:07 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=33,cinder:UPDATE=40,cinder:INSERT=10,cinder:DELETE=4 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:38:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c583b6e0-3665-41cb-a2e6-516efa5ddba1 tempest-VolumesActionsTest-843130989 None] Acquiring lock "cinder-6731ffca-0d0c-4980-8268-337ec90c5633" by "attach_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c583b6e0-3665-41cb-a2e6-516efa5ddba1 tempest-VolumesActionsTest-843130989 None] Lock "cinder-6731ffca-0d0c-4980-8268-337ec90c5633" acquired by "attach_volume" :: waited 0.030s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c583b6e0-3665-41cb-a2e6-516efa5ddba1 tempest-VolumesActionsTest-843130989 None] Attaching volume 6731ffca-0d0c-4980-8268-337ec90c5633 to instance c8c2b7d4-3e2c-4fe5-b19c-ea406e3bb700 at mountpoint /dev/vdb on host None. Jul 08 14:38:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c583b6e0-3665-41cb-a2e6-516efa5ddba1 tempest-VolumesActionsTest-843130989 None] Attach volume completed successfully. Jul 08 14:38:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c583b6e0-3665-41cb-a2e6-516efa5ddba1 tempest-VolumesActionsTest-843130989 None] Lock "cinder-6731ffca-0d0c-4980-8268-337ec90c5633" released by "attach_volume" :: held 0.163s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ee5a2817-6649-4202-80a3-a813912cac20 tempest-VolumesActionsTest-843130989 None] Acquiring lock "cinder-6731ffca-0d0c-4980-8268-337ec90c5633-detach_volume" by "detach_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ee5a2817-6649-4202-80a3-a813912cac20 tempest-VolumesActionsTest-843130989 None] Lock "cinder-6731ffca-0d0c-4980-8268-337ec90c5633-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ee5a2817-6649-4202-80a3-a813912cac20 tempest-VolumesActionsTest-843130989 None] Detaching volume 6731ffca-0d0c-4980-8268-337ec90c5633 from instance c8c2b7d4-3e2c-4fe5-b19c-ea406e3bb700. Jul 08 14:38:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ee5a2817-6649-4202-80a3-a813912cac20 tempest-VolumesActionsTest-843130989 None] Detach volume completed successfully. Jul 08 14:38:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ee5a2817-6649-4202-80a3-a813912cac20 tempest-VolumesActionsTest-843130989 None] Lock "cinder-6731ffca-0d0c-4980-8268-337ec90c5633-detach_volume" released by "detach_volume" :: held 0.183s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c2f073ca-4250-4a03-b5f8-e3ff328af781 tempest-AttachVolumeNegativeTest-1089741081 None] Acquiring lock "cinder-3aac15bb-1a87-4cff-9738-b9ffe5515107-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c2f073ca-4250-4a03-b5f8-e3ff328af781 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "cinder-3aac15bb-1a87-4cff-9738-b9ffe5515107-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c2f073ca-4250-4a03-b5f8-e3ff328af781 tempest-AttachVolumeNegativeTest-1089741081 None] Acquiring lock "cinder-quobyte-3aac15bb-1a87-4cff-9738-b9ffe5515107" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c2f073ca-4250-4a03-b5f8-e3ff328af781 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "cinder-quobyte-3aac15bb-1a87-4cff-9738-b9ffe5515107" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:12 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad657f5e-451a-4128-be2a-c1b38c9da0a2]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c2f073ca-4250-4a03-b5f8-e3ff328af781 tempest-AttachVolumeNegativeTest-1089741081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3aac15bb-1a87-4cff-9738-b9ffe5515107 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:12 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3aac15bb-1a87-4cff-9738-b9ffe5515107 Jul 08 14:38:12 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:13 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c2f073ca-4250-4a03-b5f8-e3ff328af781 tempest-AttachVolumeNegativeTest-1089741081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3aac15bb-1a87-4cff-9738-b9ffe5515107" returned: 0 in 1.077s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c2f073ca-4250-4a03-b5f8-e3ff328af781 tempest-AttachVolumeNegativeTest-1089741081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3aac15bb-1a87-4cff-9738-b9ffe5515107 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:13 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3aac15bb-1a87-4cff-9738-b9ffe5515107 Jul 08 14:38:13 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:14 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c2f073ca-4250-4a03-b5f8-e3ff328af781 tempest-AttachVolumeNegativeTest-1089741081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3aac15bb-1a87-4cff-9738-b9ffe5515107" returned: 0 in 1.070s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c2f073ca-4250-4a03-b5f8-e3ff328af781 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "cinder-quobyte-3aac15bb-1a87-4cff-9738-b9ffe5515107" released by "delete_volume" :: held 2.209s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:14 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-c2f073ca-4250-4a03-b5f8-e3ff328af781 tempest-AttachVolumeNegativeTest-1089741081 None] Created reservations ['49968765-72a7-434c-8f1b-11bf32d763d8', '1fc500ce-6eea-4b9d-aad5-d4b1ffac105d', '2dbe8ac9-0320-4173-ab71-f1ab350eece4', '3244d76c-1e9c-44a2-ae7d-a2e6692b8e7b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c2f073ca-4250-4a03-b5f8-e3ff328af781 tempest-AttachVolumeNegativeTest-1089741081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c2f073ca-4250-4a03-b5f8-e3ff328af781 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c2f073ca-4250-4a03-b5f8-e3ff328af781 tempest-AttachVolumeNegativeTest-1089741081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c2f073ca-4250-4a03-b5f8-e3ff328af781 tempest-AttachVolumeNegativeTest-1089741081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c2f073ca-4250-4a03-b5f8-e3ff328af781 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c2f073ca-4250-4a03-b5f8-e3ff328af781 tempest-AttachVolumeNegativeTest-1089741081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:15 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:38:15 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Flow 'volume_create_manager' (3d9a1c7e-84e2-4574-9ec0-d0b59fffc6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ffcd94d-5063-4c9e-8ab0-c8372735520c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ffcd94d-5063-4c9e-8ab0-c8372735520c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1770715649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=787138d3-d293-4020-979e-2a1242b132b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e5b0a8a5ea2405f8872c39275ba142c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:38:15Z,use_quota=True,user_id='3c3de512637040c28a5c8557f8ebea7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de027e5b-4238-4a1b-ae12-b0bd1fc50bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de027e5b-4238-4a1b-ae12-b0bd1fc50bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (088c2a42-39ba-4722-a350-3bd7f93b3487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (088c2a42-39ba-4722-a350-3bd7f93b3487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '787138d3-d293-4020-979e-2a1242b132b1', 'volume_name': 'volume-787138d3-d293-4020-979e-2a1242b132b1', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c864fc7-0edc-47fd-86a6-46b5aa950751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c864fc7-0edc-47fd-86a6-46b5aa950751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd39672-e850-4dfc-a400-01ff9771adfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:15 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Volume 787138d3-d293-4020-979e-2a1242b132b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-787138d3-d293-4020-979e-2a1242b132b1', 'volume_size': 1} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1770715649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=787138d3-d293-4020-979e-2a1242b132b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e5b0a8a5ea2405f8872c39275ba142c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:38:15Z,use_quota=True,user_id='3c3de512637040c28a5c8557f8ebea7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Creating volume 787138d3-d293-4020-979e-2a1242b132b1 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:38:15 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:38:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:15 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1 1073741824 Jul 08 14:38:15 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-246dff16-c282-4b41-971f-3578d85b4338 tempest-AttachVolumeNegativeTest-1089741081 None] Acquiring lock "cinder-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-246dff16-c282-4b41-971f-3578d85b4338 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "cinder-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:16 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c2f073ca-4250-4a03-b5f8-e3ff328af781 tempest-AttachVolumeNegativeTest-1089741081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.197s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:16 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-c2f073ca-4250-4a03-b5f8-e3ff328af781 tempest-AttachVolumeNegativeTest-1089741081 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:38:16 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c2f073ca-4250-4a03-b5f8-e3ff328af781 tempest-AttachVolumeNegativeTest-1089741081 None] Deleted volume successfully. Jul 08 14:38:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-246dff16-c282-4b41-971f-3578d85b4338 tempest-AttachVolumeNegativeTest-1089741081 None] Acquiring lock "cinder-quobyte-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c2f073ca-4250-4a03-b5f8-e3ff328af781 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "cinder-3aac15bb-1a87-4cff-9738-b9ffe5515107-delete_volume" released by "delete_volume" :: held 3.838s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-246dff16-c282-4b41-971f-3578d85b4338 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "cinder-quobyte-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83" acquired by "delete_volume" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:16 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d022c2d-97e4-4529-b52a-6adf12749bad]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-246dff16-c282-4b41-971f-3578d85b4338 tempest-AttachVolumeNegativeTest-1089741081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:16 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83 Jul 08 14:38:16 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:16 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1 1073741824" returned: 0 in 1.262s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:16 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1 Jul 08 14:38:16 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:17 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-246dff16-c282-4b41-971f-3578d85b4338 tempest-AttachVolumeNegativeTest-1089741081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83" returned: 0 in 1.090s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-246dff16-c282-4b41-971f-3578d85b4338 tempest-AttachVolumeNegativeTest-1089741081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:17 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83 Jul 08 14:38:17 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:17 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1" returned: 0 in 0.842s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] <== create_volume: return (2162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:38:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.165s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdd39672-e850-4dfc-a400-01ff9771adfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-787138d3-d293-4020-979e-2a1242b132b1', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a891bfda-65e1-4a4d-8c5c-984fa1db612d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:17 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Volume volume-787138d3-d293-4020-979e-2a1242b132b1 (787138d3-d293-4020-979e-2a1242b132b1): created successfully Jul 08 14:38:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a891bfda-65e1-4a4d-8c5c-984fa1db612d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Flow 'volume_create_manager' (3d9a1c7e-84e2-4574-9ec0-d0b59fffc6b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:38:17 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8e86c666-b0c4-4a09-a432-13ebc6d35fa8 tempest-SnapshotDependencyTests-1238801693 None] Created volume successfully. Jul 08 14:38:18 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-246dff16-c282-4b41-971f-3578d85b4338 tempest-AttachVolumeNegativeTest-1089741081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83" returned: 0 in 0.711s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-246dff16-c282-4b41-971f-3578d85b4338 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "cinder-quobyte-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83" released by "delete_volume" :: held 1.878s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-246dff16-c282-4b41-971f-3578d85b4338 tempest-AttachVolumeNegativeTest-1089741081 None] Created reservations ['f27ab2c9-449f-459d-b514-79e9a5f1d2d3', '66dd9f94-aa45-475b-a250-0ae04a31b84d', 'cb89d8a3-f826-4d36-bf3d-3c529008598f', '7de62b45-95fc-4aa5-b219-bc7335b3f13c'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-246dff16-c282-4b41-971f-3578d85b4338 tempest-AttachVolumeNegativeTest-1089741081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-246dff16-c282-4b41-971f-3578d85b4338 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-246dff16-c282-4b41-971f-3578d85b4338 tempest-AttachVolumeNegativeTest-1089741081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-246dff16-c282-4b41-971f-3578d85b4338 tempest-AttachVolumeNegativeTest-1089741081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-246dff16-c282-4b41-971f-3578d85b4338 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-246dff16-c282-4b41-971f-3578d85b4338 tempest-AttachVolumeNegativeTest-1089741081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:18 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:38:18 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Flow 'volume_create_manager' (67074508-6c7a-4690-a9bd-d5f9a7f78576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368514fe-6cb1-4a8c-afa3-116eb003deb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (368514fe-6cb1-4a8c-afa3-116eb003deb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-693460567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fdf42a2-4592-46ae-ba02-2a44b5a52302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b985b59b0e7a4ee3a6de0fbeb9082b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:38:19Z,use_quota=True,user_id='5bc05c579af746a89328159ec126108b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c16f7e8-9c41-4a95-a433-c552213d7960),volume_type_id=4c16f7e8-9c41-4a95-a433-c552213d7960)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac219102-ef21-4714-8e74-3ecf56249adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac219102-ef21-4714-8e74-3ecf56249adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188addec-2447-4e77-bc81-400f2698a708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188addec-2447-4e77-bc81-400f2698a708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fdf42a2-4592-46ae-ba02-2a44b5a52302', 'volume_name': 'volume-9fdf42a2-4592-46ae-ba02-2a44b5a52302', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b4e5a4e-5db1-41b8-9f17-af74a9acde4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b4e5a4e-5db1-41b8-9f17-af74a9acde4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d124260a-ab46-4b8f-adcd-972a5f85d63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:18 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Volume 9fdf42a2-4592-46ae-ba02-2a44b5a52302: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fdf42a2-4592-46ae-ba02-2a44b5a52302', 'volume_size': 1} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-693460567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fdf42a2-4592-46ae-ba02-2a44b5a52302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b985b59b0e7a4ee3a6de0fbeb9082b15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:38:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:38:19Z,use_quota=True,user_id='5bc05c579af746a89328159ec126108b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4c16f7e8-9c41-4a95-a433-c552213d7960),volume_type_id=4c16f7e8-9c41-4a95-a433-c552213d7960)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Creating volume 9fdf42a2-4592-46ae-ba02-2a44b5a52302 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:38:18 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9fdf42a2-4592-46ae-ba02-2a44b5a52302 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:18 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9fdf42a2-4592-46ae-ba02-2a44b5a52302 1073741824 Jul 08 14:38:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a123eb33-b01e-40ac-bdb7-45d243d763d6 tempest-SnapshotDependencyTests-1238801693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:18 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6f49c619-9616-4804-a915-3e759a0cc8e6 tempest-AttachVolumeNegativeTest-1089741081 None] Acquiring lock "cinder-fc9882a2-f66e-41c1-bdef-287c7a19261d-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6f49c619-9616-4804-a915-3e759a0cc8e6 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "cinder-fc9882a2-f66e-41c1-bdef-287c7a19261d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6f49c619-9616-4804-a915-3e759a0cc8e6 tempest-AttachVolumeNegativeTest-1089741081 None] Acquiring lock "cinder-quobyte-fc9882a2-f66e-41c1-bdef-287c7a19261d" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6f49c619-9616-4804-a915-3e759a0cc8e6 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "cinder-quobyte-fc9882a2-f66e-41c1-bdef-287c7a19261d" acquired by "delete_volume" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:19 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc8c15c-7d12-44c8-8ebb-1b2ec373b474]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6f49c619-9616-4804-a915-3e759a0cc8e6 tempest-AttachVolumeNegativeTest-1089741081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fc9882a2-f66e-41c1-bdef-287c7a19261d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:19 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-246dff16-c282-4b41-971f-3578d85b4338 tempest-AttachVolumeNegativeTest-1089741081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.917s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:19 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-246dff16-c282-4b41-971f-3578d85b4338 tempest-AttachVolumeNegativeTest-1089741081 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:38:19 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-246dff16-c282-4b41-971f-3578d85b4338 tempest-AttachVolumeNegativeTest-1089741081 None] Deleted volume successfully. Jul 08 14:38:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-246dff16-c282-4b41-971f-3578d85b4338 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "cinder-f0dd36ce-6b5d-4516-b0f8-8ee502b45f83-delete_volume" released by "delete_volume" :: held 3.124s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:19 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fc9882a2-f66e-41c1-bdef-287c7a19261d Jul 08 14:38:19 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:19 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9fdf42a2-4592-46ae-ba02-2a44b5a52302 1073741824" returned: 0 in 1.069s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9fdf42a2-4592-46ae-ba02-2a44b5a52302 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:20 devstack sudo[98008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9fdf42a2-4592-46ae-ba02-2a44b5a52302 Jul 08 14:38:20 devstack sudo[98008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:20 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6f49c619-9616-4804-a915-3e759a0cc8e6 tempest-AttachVolumeNegativeTest-1089741081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fc9882a2-f66e-41c1-bdef-287c7a19261d" returned: 0 in 0.907s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6f49c619-9616-4804-a915-3e759a0cc8e6 tempest-AttachVolumeNegativeTest-1089741081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fc9882a2-f66e-41c1-bdef-287c7a19261d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:20 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fc9882a2-f66e-41c1-bdef-287c7a19261d Jul 08 14:38:20 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:20 devstack sudo[98008]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9fdf42a2-4592-46ae-ba02-2a44b5a52302" returned: 0 in 0.752s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:38:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.873s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a123eb33-b01e-40ac-bdb7-45d243d763d6 tempest-SnapshotDependencyTests-1238801693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.828s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a123eb33-b01e-40ac-bdb7-45d243d763d6 tempest-SnapshotDependencyTests-1238801693 None] Creating offline snapshot de22b273-340f-40f4-8847-b3947b8695d6 of volume 787138d3-d293-4020-979e-2a1242b132b1 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:38:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d124260a-ab46-4b8f-adcd-972a5f85d63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fdf42a2-4592-46ae-ba02-2a44b5a52302', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a384c4-a01c-48de-b0c8-d6dc4d922092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:20 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3006234-b22d-4746-add6-6203dcdb2bfc]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a123eb33-b01e-40ac-bdb7-45d243d763d6 tempest-SnapshotDependencyTests-1238801693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:20 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Volume volume-9fdf42a2-4592-46ae-ba02-2a44b5a52302 (9fdf42a2-4592-46ae-ba02-2a44b5a52302): created successfully Jul 08 14:38:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a384c4-a01c-48de-b0c8-d6dc4d922092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Flow 'volume_create_manager' (67074508-6c7a-4690-a9bd-d5f9a7f78576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:38:20 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-267f4775-c3fe-465f-b2f5-3c88a44d0596 tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Created volume successfully. Jul 08 14:38:20 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6f49c619-9616-4804-a915-3e759a0cc8e6 tempest-AttachVolumeNegativeTest-1089741081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fc9882a2-f66e-41c1-bdef-287c7a19261d" returned: 0 in 0.816s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:20 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1 Jul 08 14:38:20 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6f49c619-9616-4804-a915-3e759a0cc8e6 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "cinder-quobyte-fc9882a2-f66e-41c1-bdef-287c7a19261d" released by "delete_volume" :: held 1.797s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:21 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-6f49c619-9616-4804-a915-3e759a0cc8e6 tempest-AttachVolumeNegativeTest-1089741081 None] Created reservations ['af079bf2-16cc-49f0-a0f4-fc4fbff8beab', '3391b32c-7f33-41c3-9c18-2ddcfcb194ea', '3ba8d3fb-ed8b-4596-aa1a-ca98dc55d821', 'f87fd6ab-0897-4374-ab68-6def515f3da7'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:38:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6f49c619-9616-4804-a915-3e759a0cc8e6 tempest-AttachVolumeNegativeTest-1089741081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6f49c619-9616-4804-a915-3e759a0cc8e6 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:21 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6f49c619-9616-4804-a915-3e759a0cc8e6 tempest-AttachVolumeNegativeTest-1089741081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:38:21 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6f49c619-9616-4804-a915-3e759a0cc8e6 tempest-AttachVolumeNegativeTest-1089741081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:38:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6f49c619-9616-4804-a915-3e759a0cc8e6 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6f49c619-9616-4804-a915-3e759a0cc8e6 tempest-AttachVolumeNegativeTest-1089741081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:21 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:38:21 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:21 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6f49c619-9616-4804-a915-3e759a0cc8e6 tempest-AttachVolumeNegativeTest-1089741081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.839s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:21 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-6f49c619-9616-4804-a915-3e759a0cc8e6 tempest-AttachVolumeNegativeTest-1089741081 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:38:21 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6f49c619-9616-4804-a915-3e759a0cc8e6 tempest-AttachVolumeNegativeTest-1089741081 None] Deleted volume successfully. Jul 08 14:38:22 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6f49c619-9616-4804-a915-3e759a0cc8e6 tempest-AttachVolumeNegativeTest-1089741081 None] Lock "cinder-fc9882a2-f66e-41c1-bdef-287c7a19261d-delete_volume" released by "delete_volume" :: held 2.987s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a123eb33-b01e-40ac-bdb7-45d243d763d6 tempest-SnapshotDependencyTests-1238801693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1" returned: 0 in 1.237s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a123eb33-b01e-40ac-bdb7-45d243d763d6 tempest-SnapshotDependencyTests-1238801693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.de22b273-340f-40f4-8847-b3947b8695d6 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:22 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.de22b273-340f-40f4-8847-b3947b8695d6 1G Jul 08 14:38:22 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8ffb9c0c-f9cf-4fdd-b1d3-0ad7a876cf6f tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8ffb9c0c-f9cf-4fdd-b1d3-0ad7a876cf6f tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8ffb9c0c-f9cf-4fdd-b1d3-0ad7a876cf6f tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:38:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8ffb9c0c-f9cf-4fdd-b1d3-0ad7a876cf6f tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:38:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8ffb9c0c-f9cf-4fdd-b1d3-0ad7a876cf6f tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8ffb9c0c-f9cf-4fdd-b1d3-0ad7a876cf6f tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:22 devstack sudo[98028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:38:22 devstack sudo[98028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:23 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a123eb33-b01e-40ac-bdb7-45d243d763d6 tempest-SnapshotDependencyTests-1238801693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.de22b273-340f-40f4-8847-b3947b8695d6 1G" returned: 0 in 1.205s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a123eb33-b01e-40ac-bdb7-45d243d763d6 tempest-SnapshotDependencyTests-1238801693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787138d3-d293-4020-979e-2a1242b132b1 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.de22b273-340f-40f4-8847-b3947b8695d6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:23 devstack sudo[98034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787138d3-d293-4020-979e-2a1242b132b1 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.de22b273-340f-40f4-8847-b3947b8695d6 Jul 08 14:38:23 devstack sudo[98034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:23 devstack sudo[98028]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8ffb9c0c-f9cf-4fdd-b1d3-0ad7a876cf6f tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.901s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:23 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-8ffb9c0c-f9cf-4fdd-b1d3-0ad7a876cf6f tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:38:23 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8ffb9c0c-f9cf-4fdd-b1d3-0ad7a876cf6f tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Retype volume completed successfully. Jul 08 14:38:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cb80d1cf-86d9-49f4-8095-f12784899c4c tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Acquiring lock "cinder-9fdf42a2-4592-46ae-ba02-2a44b5a52302-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cb80d1cf-86d9-49f4-8095-f12784899c4c tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Lock "cinder-9fdf42a2-4592-46ae-ba02-2a44b5a52302-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cb80d1cf-86d9-49f4-8095-f12784899c4c tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Acquiring lock "cinder-quobyte-9fdf42a2-4592-46ae-ba02-2a44b5a52302" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cb80d1cf-86d9-49f4-8095-f12784899c4c tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Lock "cinder-quobyte-9fdf42a2-4592-46ae-ba02-2a44b5a52302" acquired by "delete_volume" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:24 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcc64ff-8db5-4069-809d-ce233f1f3a66]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cb80d1cf-86d9-49f4-8095-f12784899c4c tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9fdf42a2-4592-46ae-ba02-2a44b5a52302 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:24 devstack sudo[98041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9fdf42a2-4592-46ae-ba02-2a44b5a52302 Jul 08 14:38:24 devstack sudo[98041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:24 devstack sudo[98034]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a123eb33-b01e-40ac-bdb7-45d243d763d6 tempest-SnapshotDependencyTests-1238801693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-787138d3-d293-4020-979e-2a1242b132b1 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.de22b273-340f-40f4-8847-b3947b8695d6" returned: 0 in 1.153s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:24 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-a123eb33-b01e-40ac-bdb7-45d243d763d6 tempest-SnapshotDependencyTests-1238801693 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.de22b273-340f-40f4-8847-b3947b8695d6 is being set with open permissions: ugo+rw Jul 08 14:38:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a123eb33-b01e-40ac-bdb7-45d243d763d6 tempest-SnapshotDependencyTests-1238801693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.de22b273-340f-40f4-8847-b3947b8695d6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:24 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.de22b273-340f-40f4-8847-b3947b8695d6 Jul 08 14:38:24 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:25 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a123eb33-b01e-40ac-bdb7-45d243d763d6 tempest-SnapshotDependencyTests-1238801693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.de22b273-340f-40f4-8847-b3947b8695d6" returned: 0 in 0.892s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a123eb33-b01e-40ac-bdb7-45d243d763d6 tempest-SnapshotDependencyTests-1238801693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:25 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.info Jul 08 14:38:25 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:25 devstack sudo[98041]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cb80d1cf-86d9-49f4-8095-f12784899c4c tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9fdf42a2-4592-46ae-ba02-2a44b5a52302" returned: 0 in 1.150s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cb80d1cf-86d9-49f4-8095-f12784899c4c tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9fdf42a2-4592-46ae-ba02-2a44b5a52302 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:25 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9fdf42a2-4592-46ae-ba02-2a44b5a52302 Jul 08 14:38:25 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:26 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cb80d1cf-86d9-49f4-8095-f12784899c4c tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9fdf42a2-4592-46ae-ba02-2a44b5a52302" returned: 0 in 0.797s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cb80d1cf-86d9-49f4-8095-f12784899c4c tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Lock "cinder-quobyte-9fdf42a2-4592-46ae-ba02-2a44b5a52302" released by "delete_volume" :: held 2.032s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:26 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a123eb33-b01e-40ac-bdb7-45d243d763d6 tempest-SnapshotDependencyTests-1238801693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.info" returned: 0 in 0.954s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:26 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-a123eb33-b01e-40ac-bdb7-45d243d763d6 tempest-SnapshotDependencyTests-1238801693 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.info is being set with open permissions: ugo+rw Jul 08 14:38:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a123eb33-b01e-40ac-bdb7-45d243d763d6 tempest-SnapshotDependencyTests-1238801693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:26 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.info Jul 08 14:38:26 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:26 devstack cinder-volume[87240]: WARNING cinder.quota [None req-cb80d1cf-86d9-49f4-8095-f12784899c4c tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:38:26 devstack cinder-volume[87240]: WARNING cinder.quota [None req-cb80d1cf-86d9-49f4-8095-f12784899c4c tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:38:26 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-cb80d1cf-86d9-49f4-8095-f12784899c4c tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Created reservations ['5542e17d-83b3-4168-9491-0a98e7ea7b27', '50f9d5fd-49ed-40b9-87fa-d577ff591788', '834d7f33-ddd1-4c58-87a2-2d095e248ade', '900597c7-2c83-4d5d-8fa8-623d5f3fd25e'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:38:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cb80d1cf-86d9-49f4-8095-f12784899c4c tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cb80d1cf-86d9-49f4-8095-f12784899c4c tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-cb80d1cf-86d9-49f4-8095-f12784899c4c tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:38:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-cb80d1cf-86d9-49f4-8095-f12784899c4c tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:38:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-cb80d1cf-86d9-49f4-8095-f12784899c4c tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cb80d1cf-86d9-49f4-8095-f12784899c4c tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:26 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:38:26 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:27 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a123eb33-b01e-40ac-bdb7-45d243d763d6 tempest-SnapshotDependencyTests-1238801693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.info" returned: 0 in 0.868s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a123eb33-b01e-40ac-bdb7-45d243d763d6 tempest-SnapshotDependencyTests-1238801693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.435s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:27 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a123eb33-b01e-40ac-bdb7-45d243d763d6 tempest-SnapshotDependencyTests-1238801693 None] Create snapshot completed successfully Jul 08 14:38:27 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-cb80d1cf-86d9-49f4-8095-f12784899c4c tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.952s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:27 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-cb80d1cf-86d9-49f4-8095-f12784899c4c tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:38:27 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-cb80d1cf-86d9-49f4-8095-f12784899c4c tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Deleted volume successfully. Jul 08 14:38:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-cb80d1cf-86d9-49f4-8095-f12784899c4c tempest-VolumeRetypeWithoutMigrationTest-1721118149 None] Lock "cinder-9fdf42a2-4592-46ae-ba02-2a44b5a52302-delete_volume" released by "delete_volume" :: held 3.398s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Flow 'volume_create_manager' (78db6ad3-6595-416c-af6b-ba6a0b0af5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (771bdc1a-afa9-429e-9a55-9b160bbdb22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (771bdc1a-afa9-429e-9a55-9b160bbdb22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85dd9ab8-ebc2-45e9-91b5-a420897f1173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e5b0a8a5ea2405f8872c39275ba142c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=de22b273-340f-40f4-8847-b3947b8695d6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:38:28Z,use_quota=True,user_id='3c3de512637040c28a5c8557f8ebea7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2924ed-d9f2-4af4-9514-a8d398926aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed2924ed-d9f2-4af4-9514-a8d398926aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47c9cad-ecb7-4b4a-9393-705a2f49cb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d47c9cad-ecb7-4b4a-9393-705a2f49cb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '85dd9ab8-ebc2-45e9-91b5-a420897f1173', 'volume_name': 'volume-85dd9ab8-ebc2-45e9-91b5-a420897f1173', 'volume_size': 1, 'snapshot_id': 'de22b273-340f-40f4-8847-b3947b8695d6'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e3b73c-589c-4de1-9fe4-2828421a69f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e3b73c-589c-4de1-9fe4-2828421a69f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961f0aad-d959-4fff-8535-f4264725421c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:28 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Volume 85dd9ab8-ebc2-45e9-91b5-a420897f1173: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-85dd9ab8-ebc2-45e9-91b5-a420897f1173', 'volume_size': 1, 'snapshot_id': 'de22b273-340f-40f4-8847-b3947b8695d6'} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Acquiring lock "cinder-quobyte-de22b273-340f-40f4-8847-b3947b8695d6-85dd9ab8-ebc2-45e9-91b5-a420897f1173" by "_create_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Lock "cinder-quobyte-de22b273-340f-40f4-8847-b3947b8695d6-85dd9ab8-ebc2-45e9-91b5-a420897f1173" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Creating volume 85dd9ab8-ebc2-45e9-91b5-a420897f1173 from snapshot de22b273-340f-40f4-8847-b3947b8695d6 {{(pid=87240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Acquiring lock "cinder-quobyte-85dd9ab8-ebc2-45e9-91b5-a420897f1173" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Lock "cinder-quobyte-85dd9ab8-ebc2-45e9-91b5-a420897f1173" acquired by "_copy_volume_from_snapshot" :: waited 0.068s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] snapshot: de22b273-340f-40f4-8847-b3947b8695d6, volume: 85dd9ab8-ebc2-45e9-91b5-a420897f1173, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb300963-767f-45c5-9191-8a972be8c56c]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.de22b273-340f-40f4-8847-b3947b8695d6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:29 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.de22b273-340f-40f4-8847-b3947b8695d6 Jul 08 14:38:29 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:30 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.de22b273-340f-40f4-8847-b3947b8695d6" returned: 0 in 1.245s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-787138d3-d293-4020-979e-2a1242b132b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:38:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1 {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:38:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:38:30 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eacd30d-f5b0-4a03-894b-659b4688bd1c]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:30 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1 Jul 08 14:38:30 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:31 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1" returned: 0 in 1.052s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:31 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Path /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-85dd9ab8-ebc2-45e9-91b5-a420897f1173 not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:38:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-85dd9ab8-ebc2-45e9-91b5-a420897f1173 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:31 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-85dd9ab8-ebc2-45e9-91b5-a420897f1173 Jul 08 14:38:31 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:32 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:38:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Flow 'volume_create_manager' (9c1a2d80-f446-4a59-aae4-710b2e5db93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:38:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c38fb5-cce5-4e99-be7c-496bb765d7f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c38fb5-cce5-4e99-be7c-496bb765d7f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-494042359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a2a1888fa1c540d8ac4879793c11696b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:38:32Z,use_quota=True,user_id='37f39b7f52d9465fb952da60a59e35a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a2413b-053c-40de-a865-879da987ba1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75a2413b-053c-40de-a865-879da987ba1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e76645-4055-4d76-b599-96ff0db0c2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66e76645-4055-4d76-b599-96ff0db0c2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf', 'volume_name': 'volume-bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ad4073-c69b-4f2b-bf51-7a1811b6f4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56ad4073-c69b-4f2b-bf51-7a1811b6f4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56e093b-0a50-4910-b8c8-f55101a71802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:32 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Volume bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf', 'volume_size': 1} Jul 08 14:38:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:38 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-85dd9ab8-ebc2-45e9-91b5-a420897f1173" returned: 0 in 6.847s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:38 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[05161fbe-150f-4512-8350-8caa1025db52]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:38 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1 Jul 08 14:38:38 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:39 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1" returned: 0 in 1.161s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:39 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Image conversion details: src /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1, size 1024.00 MB, duration 6.85 sec, destination /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-85dd9ab8-ebc2-45e9-91b5-a420897f1173 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:38:39 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Converted 1024.00 MB image at 149.54 MB/s Jul 08 14:38:39 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-85dd9ab8-ebc2-45e9-91b5-a420897f1173 is being set with open permissions: ugo+rw Jul 08 14:38:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-85dd9ab8-ebc2-45e9-91b5-a420897f1173 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:39 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-85dd9ab8-ebc2-45e9-91b5-a420897f1173 Jul 08 14:38:39 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:40 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-85dd9ab8-ebc2-45e9-91b5-a420897f1173" returned: 0 in 0.842s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Lock "cinder-quobyte-85dd9ab8-ebc2-45e9-91b5-a420897f1173" released by "_copy_volume_from_snapshot" :: held 11.324s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Lock "cinder-quobyte-de22b273-340f-40f4-8847-b3947b8695d6-85dd9ab8-ebc2-45e9-91b5-a420897f1173" released by "_create_volume_from_snapshot" :: held 11.426s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.451s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.403s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-494042359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a2a1888fa1c540d8ac4879793c11696b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:38:32Z,use_quota=True,user_id='37f39b7f52d9465fb952da60a59e35a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:38:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Creating volume bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:38:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:38:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:38:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:38:40 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:38:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:40 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf 1073741824 Jul 08 14:38:40 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (961f0aad-d959-4fff-8535-f4264725421c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85dd9ab8-ebc2-45e9-91b5-a420897f1173', 'volume_size': 1, 'snapshot_id': 'de22b273-340f-40f4-8847-b3947b8695d6'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64960ac6-8ffe-4cb9-9e88-b1813e582b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:40 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Volume volume-85dd9ab8-ebc2-45e9-91b5-a420897f1173 (85dd9ab8-ebc2-45e9-91b5-a420897f1173): created successfully Jul 08 14:38:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64960ac6-8ffe-4cb9-9e88-b1813e582b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Flow 'volume_create_manager' (78db6ad3-6595-416c-af6b-ba6a0b0af5ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:38:40 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8c04cc8f-f077-4018-bd5e-ab2d77d8cb0d tempest-SnapshotDependencyTests-1238801693 None] Created volume successfully. Jul 08 14:38:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-57f8dd4f-9852-4f94-8600-bcec4997e06c tempest-VolumesActionsTest-843130989 None] Acquiring lock "cinder-6731ffca-0d0c-4980-8268-337ec90c5633" by "attach_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-57f8dd4f-9852-4f94-8600-bcec4997e06c tempest-VolumesActionsTest-843130989 None] Lock "cinder-6731ffca-0d0c-4980-8268-337ec90c5633" acquired by "attach_volume" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a30cea06-6458-402a-8320-315cfd0b48e7 tempest-SnapshotDependencyTests-1238801693 None] Acquiring lock "cinder-de22b273-340f-40f4-8847-b3947b8695d6-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a30cea06-6458-402a-8320-315cfd0b48e7 tempest-SnapshotDependencyTests-1238801693 None] Lock "cinder-de22b273-340f-40f4-8847-b3947b8695d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a30cea06-6458-402a-8320-315cfd0b48e7 tempest-SnapshotDependencyTests-1238801693 None] Acquiring lock "cinder-quobyte-787138d3-d293-4020-979e-2a1242b132b1" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:41 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-57f8dd4f-9852-4f94-8600-bcec4997e06c tempest-VolumesActionsTest-843130989 None] Attaching volume 6731ffca-0d0c-4980-8268-337ec90c5633 to instance 699c99a1-1e65-43c4-9034-0b6e8102123b at mountpoint /dev/vdb on host None. Jul 08 14:38:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a30cea06-6458-402a-8320-315cfd0b48e7 tempest-SnapshotDependencyTests-1238801693 None] Lock "cinder-quobyte-787138d3-d293-4020-979e-2a1242b132b1" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a30cea06-6458-402a-8320-315cfd0b48e7 tempest-SnapshotDependencyTests-1238801693 None] Acquiring lock "cinder-quobyte-de22b273-340f-40f4-8847-b3947b8695d6" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:41 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-57f8dd4f-9852-4f94-8600-bcec4997e06c tempest-VolumesActionsTest-843130989 None] Attach volume completed successfully. Jul 08 14:38:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a30cea06-6458-402a-8320-315cfd0b48e7 tempest-SnapshotDependencyTests-1238801693 None] Lock "cinder-quobyte-de22b273-340f-40f4-8847-b3947b8695d6" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a30cea06-6458-402a-8320-315cfd0b48e7 tempest-SnapshotDependencyTests-1238801693 None] Deleting offline snapshot de22b273-340f-40f4-8847-b3947b8695d6 of volume 787138d3-d293-4020-979e-2a1242b132b1 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:38:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a30cea06-6458-402a-8320-315cfd0b48e7 tempest-SnapshotDependencyTests-1238801693 None] snapshot_file for this snap is: volume-787138d3-d293-4020-979e-2a1242b132b1.de22b273-340f-40f4-8847-b3947b8695d6 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:38:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-57f8dd4f-9852-4f94-8600-bcec4997e06c tempest-VolumesActionsTest-843130989 None] Lock "cinder-6731ffca-0d0c-4980-8268-337ec90c5633" released by "attach_volume" :: held 0.298s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:41 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[26542e61-4518-42d6-9e5a-a5e569b90c8a]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a30cea06-6458-402a-8320-315cfd0b48e7 tempest-SnapshotDependencyTests-1238801693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.de22b273-340f-40f4-8847-b3947b8695d6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:41 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf 1073741824" returned: 0 in 1.330s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:41 devstack sudo[98192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.de22b273-340f-40f4-8847-b3947b8695d6 Jul 08 14:38:41 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:41 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf Jul 08 14:38:41 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-12d28c08-4b41-4bfb-9d19-bbe8571e6cd9 tempest-VolumesActionsTest-843130989 None] Acquiring lock "cinder-6731ffca-0d0c-4980-8268-337ec90c5633-detach_volume" by "detach_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-12d28c08-4b41-4bfb-9d19-bbe8571e6cd9 tempest-VolumesActionsTest-843130989 None] Lock "cinder-6731ffca-0d0c-4980-8268-337ec90c5633-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-12d28c08-4b41-4bfb-9d19-bbe8571e6cd9 tempest-VolumesActionsTest-843130989 None] Detaching volume 6731ffca-0d0c-4980-8268-337ec90c5633 from instance 699c99a1-1e65-43c4-9034-0b6e8102123b. Jul 08 14:38:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-12d28c08-4b41-4bfb-9d19-bbe8571e6cd9 tempest-VolumesActionsTest-843130989 None] Detach volume completed successfully. Jul 08 14:38:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-12d28c08-4b41-4bfb-9d19-bbe8571e6cd9 tempest-VolumesActionsTest-843130989 None] Lock "cinder-6731ffca-0d0c-4980-8268-337ec90c5633-detach_volume" released by "detach_volume" :: held 0.113s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:42 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a30cea06-6458-402a-8320-315cfd0b48e7 tempest-SnapshotDependencyTests-1238801693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.de22b273-340f-40f4-8847-b3947b8695d6" returned: 0 in 1.217s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a30cea06-6458-402a-8320-315cfd0b48e7 tempest-SnapshotDependencyTests-1238801693 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-787138d3-d293-4020-979e-2a1242b132b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:38:42 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec08e65-0545-430c-bdb0-fa0304df863b]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a30cea06-6458-402a-8320-315cfd0b48e7 tempest-SnapshotDependencyTests-1238801693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:42 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf" returned: 0 in 1.081s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] <== create_volume: return (2526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:38:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.530s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56e093b-0a50-4910-b8c8-f55101a71802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed5b2c5-548a-4631-be15-6f838f1034f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:42 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Volume volume-bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf (bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf): created successfully Jul 08 14:38:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed5b2c5-548a-4631-be15-6f838f1034f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Flow 'volume_create_manager' (9c1a2d80-f446-4a59-aae4-710b2e5db93a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:38:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-65d31fb2-01c0-41a4-8eca-1253b31ef166 req-8f8cf588-f21b-4ed0-acc4-0ceb31a49f4f tempest-VolumesGetTestJSON-176225092 None] Created volume successfully. Jul 08 14:38:42 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1 Jul 08 14:38:42 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:44 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a30cea06-6458-402a-8320-315cfd0b48e7 tempest-SnapshotDependencyTests-1238801693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1" returned: 0 in 1.471s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a30cea06-6458-402a-8320-315cfd0b48e7 tempest-SnapshotDependencyTests-1238801693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.de22b273-340f-40f4-8847-b3947b8695d6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:44 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.de22b273-340f-40f4-8847-b3947b8695d6 Jul 08 14:38:44 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-e51c5987-6f6c-4e32-a45b-3f538d82bccc req-f8afdc61-2be7-40f9-85a7-910552e85356 tempest-VolumesGetTestJSON-176225092 None] Acquiring lock "cinder-bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-e51c5987-6f6c-4e32-a45b-3f538d82bccc req-f8afdc61-2be7-40f9-85a7-910552e85356 tempest-VolumesGetTestJSON-176225092 None] Lock "cinder-bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-e51c5987-6f6c-4e32-a45b-3f538d82bccc req-f8afdc61-2be7-40f9-85a7-910552e85356 tempest-VolumesGetTestJSON-176225092 None] Acquiring lock "cinder-quobyte-bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-e51c5987-6f6c-4e32-a45b-3f538d82bccc req-f8afdc61-2be7-40f9-85a7-910552e85356 tempest-VolumesGetTestJSON-176225092 None] Lock "cinder-quobyte-bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[060b668b-9989-4706-ad16-dac89939772d]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-e51c5987-6f6c-4e32-a45b-3f538d82bccc req-f8afdc61-2be7-40f9-85a7-910552e85356 tempest-VolumesGetTestJSON-176225092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:44 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf Jul 08 14:38:44 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:45 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a30cea06-6458-402a-8320-315cfd0b48e7 tempest-SnapshotDependencyTests-1238801693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.de22b273-340f-40f4-8847-b3947b8695d6" returned: 0 in 1.098s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a30cea06-6458-402a-8320-315cfd0b48e7 tempest-SnapshotDependencyTests-1238801693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.de22b273-340f-40f4-8847-b3947b8695d6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:45 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.de22b273-340f-40f4-8847-b3947b8695d6 Jul 08 14:38:45 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:45 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-e51c5987-6f6c-4e32-a45b-3f538d82bccc req-f8afdc61-2be7-40f9-85a7-910552e85356 tempest-VolumesGetTestJSON-176225092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf" returned: 0 in 1.233s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-e51c5987-6f6c-4e32-a45b-3f538d82bccc req-f8afdc61-2be7-40f9-85a7-910552e85356 tempest-VolumesGetTestJSON-176225092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:45 devstack sudo[98277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf Jul 08 14:38:45 devstack sudo[98277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:46 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a30cea06-6458-402a-8320-315cfd0b48e7 tempest-SnapshotDependencyTests-1238801693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1.de22b273-340f-40f4-8847-b3947b8695d6" returned: 0 in 0.884s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a30cea06-6458-402a-8320-315cfd0b48e7 tempest-SnapshotDependencyTests-1238801693 None] Lock "cinder-quobyte-de22b273-340f-40f4-8847-b3947b8695d6" released by "_delete_snapshot" :: held 4.865s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a30cea06-6458-402a-8320-315cfd0b48e7 tempest-SnapshotDependencyTests-1238801693 None] Lock "cinder-quobyte-787138d3-d293-4020-979e-2a1242b132b1" released by "delete_snapshot" :: held 4.926s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-a30cea06-6458-402a-8320-315cfd0b48e7 tempest-SnapshotDependencyTests-1238801693 None] Created reservations ['c7c4835d-0003-4eaa-9eee-aa4f59141ae7', '2e07c2e5-bf87-4690-b9b4-ecfd05200b04', 'f7e9c3ee-f9af-4aa6-b472-92952d95ac5d', '50072c6c-fb1f-46c9-94a7-5160b3ee0ce2'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:38:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a30cea06-6458-402a-8320-315cfd0b48e7 tempest-SnapshotDependencyTests-1238801693 None] Delete snapshot completed successfully. Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a30cea06-6458-402a-8320-315cfd0b48e7 tempest-SnapshotDependencyTests-1238801693 None] Lock "cinder-de22b273-340f-40f4-8847-b3947b8695d6-delete_snapshot" released by "delete_snapshot" :: held 5.258s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:46 devstack sudo[98277]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-e51c5987-6f6c-4e32-a45b-3f538d82bccc req-f8afdc61-2be7-40f9-85a7-910552e85356 tempest-VolumesGetTestJSON-176225092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf" returned: 0 in 1.053s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c77249bc-b018-40ac-a24b-25dbecc6e237 tempest-SnapshotDependencyTests-1238801693 None] Acquiring lock "cinder-787138d3-d293-4020-979e-2a1242b132b1-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Flow 'volume_create_manager' (4ba61643-1639-49e3-97e0-4139db6ce05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a011cf90-bc8e-44f9-bf13-949118a5200a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-e51c5987-6f6c-4e32-a45b-3f538d82bccc req-f8afdc61-2be7-40f9-85a7-910552e85356 tempest-VolumesGetTestJSON-176225092 None] Lock "cinder-quobyte-bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf" released by "delete_volume" :: held 2.367s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a011cf90-bc8e-44f9-bf13-949118a5200a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1283596432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee8300c-ec4c-4e3d-a5f6-465d16827fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01474faa9cb44d35af0b40ab720b4199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:38:47Z,use_quota=True,user_id='7a17cd78bf6f4f5e893ecd9dd05fa297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8871c7b1-e11b-4769-b8f9-721482e2e55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8871c7b1-e11b-4769-b8f9-721482e2e55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b845fc-74c9-4698-a743-18d52b386113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b845fc-74c9-4698-a743-18d52b386113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ee8300c-ec4c-4e3d-a5f6-465d16827fe8', 'volume_name': 'volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (529aab1c-795e-4770-9163-8c940a0b94a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (529aab1c-795e-4770-9163-8c940a0b94a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95d4dc4-4a8b-47a7-a840-8ddcd492a824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:46 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Volume 1ee8300c-ec4c-4e3d-a5f6-465d16827fe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8', 'volume_size': 1} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1283596432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee8300c-ec4c-4e3d-a5f6-465d16827fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01474faa9cb44d35af0b40ab720b4199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:38:47Z,use_quota=True,user_id='7a17cd78bf6f4f5e893ecd9dd05fa297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Creating volume 1ee8300c-ec4c-4e3d-a5f6-465d16827fe8 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:38:46 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c77249bc-b018-40ac-a24b-25dbecc6e237 tempest-SnapshotDependencyTests-1238801693 None] Lock "cinder-787138d3-d293-4020-979e-2a1242b132b1-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:46 devstack sudo[98283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8 1073741824 Jul 08 14:38:46 devstack sudo[98283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c77249bc-b018-40ac-a24b-25dbecc6e237 tempest-SnapshotDependencyTests-1238801693 None] Acquiring lock "cinder-quobyte-787138d3-d293-4020-979e-2a1242b132b1" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.quota [req-e51c5987-6f6c-4e32-a45b-3f538d82bccc req-f8afdc61-2be7-40f9-85a7-910552e85356 tempest-VolumesGetTestJSON-176225092 None] Created reservations ['e8aab00f-785b-4da4-b2a0-95ce3b79e227', 'e46a63f8-6a36-4785-aacd-f2ce7920981e', '72d671fe-7aef-40a1-9ebd-c21dcabdf536', '531d5421-8b56-45d9-9815-2ed0af304a89'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c77249bc-b018-40ac-a24b-25dbecc6e237 tempest-SnapshotDependencyTests-1238801693 None] Lock "cinder-quobyte-787138d3-d293-4020-979e-2a1242b132b1" acquired by "delete_volume" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc95e697-1448-4a7f-b3cb-a1d45345d167]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c77249bc-b018-40ac-a24b-25dbecc6e237 tempest-SnapshotDependencyTests-1238801693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-e51c5987-6f6c-4e32-a45b-3f538d82bccc req-f8afdc61-2be7-40f9-85a7-910552e85356 tempest-VolumesGetTestJSON-176225092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-e51c5987-6f6c-4e32-a45b-3f538d82bccc req-f8afdc61-2be7-40f9-85a7-910552e85356 tempest-VolumesGetTestJSON-176225092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-e51c5987-6f6c-4e32-a45b-3f538d82bccc req-f8afdc61-2be7-40f9-85a7-910552e85356 tempest-VolumesGetTestJSON-176225092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-e51c5987-6f6c-4e32-a45b-3f538d82bccc req-f8afdc61-2be7-40f9-85a7-910552e85356 tempest-VolumesGetTestJSON-176225092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-e51c5987-6f6c-4e32-a45b-3f538d82bccc req-f8afdc61-2be7-40f9-85a7-910552e85356 tempest-VolumesGetTestJSON-176225092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-e51c5987-6f6c-4e32-a45b-3f538d82bccc req-f8afdc61-2be7-40f9-85a7-910552e85356 tempest-VolumesGetTestJSON-176225092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:46 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:38:46 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:46 devstack sudo[98285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1 Jul 08 14:38:46 devstack sudo[98285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:47 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-e51c5987-6f6c-4e32-a45b-3f538d82bccc req-f8afdc61-2be7-40f9-85a7-910552e85356 tempest-VolumesGetTestJSON-176225092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.698s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:47 devstack cinder-volume[87240]: DEBUG cinder.manager [req-e51c5987-6f6c-4e32-a45b-3f538d82bccc req-f8afdc61-2be7-40f9-85a7-910552e85356 tempest-VolumesGetTestJSON-176225092 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:38:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-e51c5987-6f6c-4e32-a45b-3f538d82bccc req-f8afdc61-2be7-40f9-85a7-910552e85356 tempest-VolumesGetTestJSON-176225092 None] Deleted volume successfully. Jul 08 14:38:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-e51c5987-6f6c-4e32-a45b-3f538d82bccc req-f8afdc61-2be7-40f9-85a7-910552e85356 tempest-VolumesGetTestJSON-176225092 None] Lock "cinder-bfb4ccfc-0ebb-4bf6-ad41-89514b43e7cf-delete_volume" released by "delete_volume" :: held 3.465s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:47 devstack sudo[98283]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8 1073741824" returned: 0 in 1.015s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:47 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8 Jul 08 14:38:47 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:47 devstack sudo[98285]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c77249bc-b018-40ac-a24b-25dbecc6e237 tempest-SnapshotDependencyTests-1238801693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1" returned: 0 in 0.973s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c77249bc-b018-40ac-a24b-25dbecc6e237 tempest-SnapshotDependencyTests-1238801693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:47 devstack sudo[98300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1 Jul 08 14:38:47 devstack sudo[98300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:48 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8" returned: 0 in 0.766s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:38:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95d4dc4-4a8b-47a7-a840-8ddcd492a824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f019bad5-33f1-4579-9fdf-aa4faf652264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:48 devstack sudo[98300]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c77249bc-b018-40ac-a24b-25dbecc6e237 tempest-SnapshotDependencyTests-1238801693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-787138d3-d293-4020-979e-2a1242b132b1" returned: 0 in 0.768s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:48 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Volume volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8 (1ee8300c-ec4c-4e3d-a5f6-465d16827fe8): created successfully Jul 08 14:38:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f019bad5-33f1-4579-9fdf-aa4faf652264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Flow 'volume_create_manager' (4ba61643-1639-49e3-97e0-4139db6ce05f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:38:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c77249bc-b018-40ac-a24b-25dbecc6e237 tempest-SnapshotDependencyTests-1238801693 None] Lock "cinder-quobyte-787138d3-d293-4020-979e-2a1242b132b1" released by "delete_volume" :: held 1.825s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:48 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6cf7eb4f-aa92-4845-a46d-db6f471736ef tempest-SnapshotMetadataTestJSON-1440965292 None] Created volume successfully. Jul 08 14:38:48 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-c77249bc-b018-40ac-a24b-25dbecc6e237 tempest-SnapshotDependencyTests-1238801693 None] Created reservations ['289e43f2-0ee0-4d18-bb01-c92362516412', '1480356d-efb9-4a2b-a519-210500fdc835', 'a3da92d5-d164-487a-aab3-54fc2f185107', 'c3b150d5-c56a-45c9-b316-da5e1cd39c8b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:38:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c77249bc-b018-40ac-a24b-25dbecc6e237 tempest-SnapshotDependencyTests-1238801693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c77249bc-b018-40ac-a24b-25dbecc6e237 tempest-SnapshotDependencyTests-1238801693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c77249bc-b018-40ac-a24b-25dbecc6e237 tempest-SnapshotDependencyTests-1238801693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:38:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c77249bc-b018-40ac-a24b-25dbecc6e237 tempest-SnapshotDependencyTests-1238801693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:38:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c77249bc-b018-40ac-a24b-25dbecc6e237 tempest-SnapshotDependencyTests-1238801693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c77249bc-b018-40ac-a24b-25dbecc6e237 tempest-SnapshotDependencyTests-1238801693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:48 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:38:48 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1836903b-fc22-45eb-998c-fb68e6aeb768 tempest-SnapshotDependencyTests-1238801693 None] Acquiring lock "cinder-85dd9ab8-ebc2-45e9-91b5-a420897f1173-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1836903b-fc22-45eb-998c-fb68e6aeb768 tempest-SnapshotDependencyTests-1238801693 None] Lock "cinder-85dd9ab8-ebc2-45e9-91b5-a420897f1173-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1836903b-fc22-45eb-998c-fb68e6aeb768 tempest-SnapshotDependencyTests-1238801693 None] Acquiring lock "cinder-quobyte-85dd9ab8-ebc2-45e9-91b5-a420897f1173" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1836903b-fc22-45eb-998c-fb68e6aeb768 tempest-SnapshotDependencyTests-1238801693 None] Lock "cinder-quobyte-85dd9ab8-ebc2-45e9-91b5-a420897f1173" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:49 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd5f5f9-cd08-46dd-8567-eb13f6eba9f8]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1836903b-fc22-45eb-998c-fb68e6aeb768 tempest-SnapshotDependencyTests-1238801693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-85dd9ab8-ebc2-45e9-91b5-a420897f1173 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:49 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-85dd9ab8-ebc2-45e9-91b5-a420897f1173 Jul 08 14:38:49 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:49 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c77249bc-b018-40ac-a24b-25dbecc6e237 tempest-SnapshotDependencyTests-1238801693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.011s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:49 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-c77249bc-b018-40ac-a24b-25dbecc6e237 tempest-SnapshotDependencyTests-1238801693 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:38:49 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c77249bc-b018-40ac-a24b-25dbecc6e237 tempest-SnapshotDependencyTests-1238801693 None] Deleted volume successfully. Jul 08 14:38:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c77249bc-b018-40ac-a24b-25dbecc6e237 tempest-SnapshotDependencyTests-1238801693 None] Lock "cinder-787138d3-d293-4020-979e-2a1242b132b1-delete_volume" released by "delete_volume" :: held 3.182s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c58ef74e-7866-4b0d-9bb8-3a65fb8e53e1 tempest-SnapshotMetadataTestJSON-1440965292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c58ef74e-7866-4b0d-9bb8-3a65fb8e53e1 tempest-SnapshotMetadataTestJSON-1440965292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c58ef74e-7866-4b0d-9bb8-3a65fb8e53e1 tempest-SnapshotMetadataTestJSON-1440965292 None] Creating offline snapshot 17296137-81fb-4d8d-893e-5ce7ab6e84dd of volume 1ee8300c-ec4c-4e3d-a5f6-465d16827fe8 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:38:50 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4178d73-6839-4bd2-a778-e4f9ea6a738c]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c58ef74e-7866-4b0d-9bb8-3a65fb8e53e1 tempest-SnapshotMetadataTestJSON-1440965292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:50 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1836903b-fc22-45eb-998c-fb68e6aeb768 tempest-SnapshotDependencyTests-1238801693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-85dd9ab8-ebc2-45e9-91b5-a420897f1173" returned: 0 in 1.212s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1836903b-fc22-45eb-998c-fb68e6aeb768 tempest-SnapshotDependencyTests-1238801693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-85dd9ab8-ebc2-45e9-91b5-a420897f1173 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:50 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-85dd9ab8-ebc2-45e9-91b5-a420897f1173 Jul 08 14:38:50 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:50 devstack sudo[98313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8 Jul 08 14:38:50 devstack sudo[98313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:51 devstack sudo[98313]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c58ef74e-7866-4b0d-9bb8-3a65fb8e53e1 tempest-SnapshotMetadataTestJSON-1440965292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8" returned: 0 in 1.159s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c58ef74e-7866-4b0d-9bb8-3a65fb8e53e1 tempest-SnapshotMetadataTestJSON-1440965292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.17296137-81fb-4d8d-893e-5ce7ab6e84dd 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:51 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.17296137-81fb-4d8d-893e-5ce7ab6e84dd 1G Jul 08 14:38:51 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:51 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1836903b-fc22-45eb-998c-fb68e6aeb768 tempest-SnapshotDependencyTests-1238801693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-85dd9ab8-ebc2-45e9-91b5-a420897f1173" returned: 0 in 1.100s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1836903b-fc22-45eb-998c-fb68e6aeb768 tempest-SnapshotDependencyTests-1238801693 None] Lock "cinder-quobyte-85dd9ab8-ebc2-45e9-91b5-a420897f1173" released by "delete_volume" :: held 2.370s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:51 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-1836903b-fc22-45eb-998c-fb68e6aeb768 tempest-SnapshotDependencyTests-1238801693 None] Created reservations ['eec6fcab-1361-4bfa-93a0-c717b1d51d3c', 'b2380cc8-71f2-4b14-9923-c30caf0afc56', '03831e4b-ec62-4a30-bff8-31514bd59818', 'b80d6389-c2e5-4ed0-bbff-36a50f7906a7'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:38:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1836903b-fc22-45eb-998c-fb68e6aeb768 tempest-SnapshotDependencyTests-1238801693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1836903b-fc22-45eb-998c-fb68e6aeb768 tempest-SnapshotDependencyTests-1238801693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1836903b-fc22-45eb-998c-fb68e6aeb768 tempest-SnapshotDependencyTests-1238801693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:38:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1836903b-fc22-45eb-998c-fb68e6aeb768 tempest-SnapshotDependencyTests-1238801693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:38:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1836903b-fc22-45eb-998c-fb68e6aeb768 tempest-SnapshotDependencyTests-1238801693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1836903b-fc22-45eb-998c-fb68e6aeb768 tempest-SnapshotDependencyTests-1238801693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:51 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:38:51 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7b622f8b-eb9a-4e59-92bd-bc85c4cfa1bd tempest-VolumesActionsTest-843130989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:52 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1836903b-fc22-45eb-998c-fb68e6aeb768 tempest-SnapshotDependencyTests-1238801693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.862s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:52 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-1836903b-fc22-45eb-998c-fb68e6aeb768 tempest-SnapshotDependencyTests-1238801693 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:38:52 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-1836903b-fc22-45eb-998c-fb68e6aeb768 tempest-SnapshotDependencyTests-1238801693 None] Deleted volume successfully. Jul 08 14:38:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1836903b-fc22-45eb-998c-fb68e6aeb768 tempest-SnapshotDependencyTests-1238801693 None] Lock "cinder-85dd9ab8-ebc2-45e9-91b5-a420897f1173-delete_volume" released by "delete_volume" :: held 3.595s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:38:52 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c58ef74e-7866-4b0d-9bb8-3a65fb8e53e1 tempest-SnapshotMetadataTestJSON-1440965292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.17296137-81fb-4d8d-893e-5ce7ab6e84dd 1G" returned: 0 in 1.217s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c58ef74e-7866-4b0d-9bb8-3a65fb8e53e1 tempest-SnapshotMetadataTestJSON-1440965292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.17296137-81fb-4d8d-893e-5ce7ab6e84dd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:52 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.17296137-81fb-4d8d-893e-5ce7ab6e84dd Jul 08 14:38:52 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:53 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:38:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Flow 'volume_create_manager' (2d0ff981-762d-4cf1-a418-e1983c582983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:38:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd10229-03c8-4928-bde8-e272ab3bcf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bd10229-03c8-4928-bde8-e272ab3bcf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1881577372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c7a91d-1413-47d1-9ac9-c48b4d109515,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='509714aefe954128b5dec04a87501c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:38:53Z,use_quota=True,user_id='9a8cf2cb7fbb4815b757605be1cdf44f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f21b28-ec76-4e6d-b9fe-4609a85de368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f21b28-ec76-4e6d-b9fe-4609a85de368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2947aebb-fcc8-4666-a71c-42cf6a4f041d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2947aebb-fcc8-4666-a71c-42cf6a4f041d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53c7a91d-1413-47d1-9ac9-c48b4d109515', 'volume_name': 'volume-53c7a91d-1413-47d1-9ac9-c48b4d109515', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b877bb7c-1a2d-46da-b7e4-a6d0fb19a822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b877bb7c-1a2d-46da-b7e4-a6d0fb19a822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:38:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e73085c-b6ca-4a59-abfd-ab3798acb908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:38:53 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Volume 53c7a91d-1413-47d1-9ac9-c48b4d109515: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53c7a91d-1413-47d1-9ac9-c48b4d109515', 'volume_size': 1} Jul 08 14:38:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:53 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c58ef74e-7866-4b0d-9bb8-3a65fb8e53e1 tempest-SnapshotMetadataTestJSON-1440965292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.17296137-81fb-4d8d-893e-5ce7ab6e84dd" returned: 0 in 0.861s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:53 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-c58ef74e-7866-4b0d-9bb8-3a65fb8e53e1 tempest-SnapshotMetadataTestJSON-1440965292 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.17296137-81fb-4d8d-893e-5ce7ab6e84dd is being set with open permissions: ugo+rw Jul 08 14:38:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c58ef74e-7866-4b0d-9bb8-3a65fb8e53e1 tempest-SnapshotMetadataTestJSON-1440965292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.17296137-81fb-4d8d-893e-5ce7ab6e84dd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:53 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.17296137-81fb-4d8d-893e-5ce7ab6e84dd Jul 08 14:38:53 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:54 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c58ef74e-7866-4b0d-9bb8-3a65fb8e53e1 tempest-SnapshotMetadataTestJSON-1440965292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.17296137-81fb-4d8d-893e-5ce7ab6e84dd" returned: 0 in 0.851s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c58ef74e-7866-4b0d-9bb8-3a65fb8e53e1 tempest-SnapshotMetadataTestJSON-1440965292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:54 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.info Jul 08 14:38:54 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:55 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c58ef74e-7866-4b0d-9bb8-3a65fb8e53e1 tempest-SnapshotMetadataTestJSON-1440965292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.info" returned: 0 in 0.816s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:55 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-c58ef74e-7866-4b0d-9bb8-3a65fb8e53e1 tempest-SnapshotMetadataTestJSON-1440965292 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.info is being set with open permissions: ugo+rw Jul 08 14:38:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c58ef74e-7866-4b0d-9bb8-3a65fb8e53e1 tempest-SnapshotMetadataTestJSON-1440965292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:55 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.info Jul 08 14:38:55 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:55 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c58ef74e-7866-4b0d-9bb8-3a65fb8e53e1 tempest-SnapshotMetadataTestJSON-1440965292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.info" returned: 0 in 0.773s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c58ef74e-7866-4b0d-9bb8-3a65fb8e53e1 tempest-SnapshotMetadataTestJSON-1440965292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.810s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7b622f8b-eb9a-4e59-92bd-bc85c4cfa1bd tempest-VolumesActionsTest-843130989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.588s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:55 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb58a31f-03dc-476c-887f-df3b979969a5]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7b622f8b-eb9a-4e59-92bd-bc85c4cfa1bd tempest-VolumesActionsTest-843130989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:55 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c58ef74e-7866-4b0d-9bb8-3a65fb8e53e1 tempest-SnapshotMetadataTestJSON-1440965292 None] Create snapshot completed successfully Jul 08 14:38:56 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 Jul 08 14:38:56 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:56 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7b622f8b-eb9a-4e59-92bd-bc85c4cfa1bd tempest-VolumesActionsTest-843130989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633" returned: 0 in 0.931s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:56 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1dbf1f-3e60-431b-bbbd-e57ac9351c7e]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7b622f8b-eb9a-4e59-92bd-bc85c4cfa1bd tempest-VolumesActionsTest-843130989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:57 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 Jul 08 14:38:57 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5ce380d7-e27e-4d2d-b530-bb1c13aad35c tempest-SnapshotMetadataTestJSON-1440965292 None] Acquiring lock "cinder-17296137-81fb-4d8d-893e-5ce7ab6e84dd-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5ce380d7-e27e-4d2d-b530-bb1c13aad35c tempest-SnapshotMetadataTestJSON-1440965292 None] Lock "cinder-17296137-81fb-4d8d-893e-5ce7ab6e84dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5ce380d7-e27e-4d2d-b530-bb1c13aad35c tempest-SnapshotMetadataTestJSON-1440965292 None] Acquiring lock "cinder-quobyte-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5ce380d7-e27e-4d2d-b530-bb1c13aad35c tempest-SnapshotMetadataTestJSON-1440965292 None] Lock "cinder-quobyte-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5ce380d7-e27e-4d2d-b530-bb1c13aad35c tempest-SnapshotMetadataTestJSON-1440965292 None] Acquiring lock "cinder-quobyte-17296137-81fb-4d8d-893e-5ce7ab6e84dd" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:38:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5ce380d7-e27e-4d2d-b530-bb1c13aad35c tempest-SnapshotMetadataTestJSON-1440965292 None] Lock "cinder-quobyte-17296137-81fb-4d8d-893e-5ce7ab6e84dd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:38:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5ce380d7-e27e-4d2d-b530-bb1c13aad35c tempest-SnapshotMetadataTestJSON-1440965292 None] Deleting offline snapshot 17296137-81fb-4d8d-893e-5ce7ab6e84dd of volume 1ee8300c-ec4c-4e3d-a5f6-465d16827fe8 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:38:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5ce380d7-e27e-4d2d-b530-bb1c13aad35c tempest-SnapshotMetadataTestJSON-1440965292 None] snapshot_file for this snap is: volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.17296137-81fb-4d8d-893e-5ce7ab6e84dd {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:38:57 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6b683a-a702-4bea-898a-bc70a468bdc5]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5ce380d7-e27e-4d2d-b530-bb1c13aad35c tempest-SnapshotMetadataTestJSON-1440965292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.17296137-81fb-4d8d-893e-5ce7ab6e84dd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:57 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.17296137-81fb-4d8d-893e-5ce7ab6e84dd Jul 08 14:38:57 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:57 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7b622f8b-eb9a-4e59-92bd-bc85c4cfa1bd tempest-VolumesActionsTest-843130989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633" returned: 0 in 0.867s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7b622f8b-eb9a-4e59-92bd-bc85c4cfa1bd tempest-VolumesActionsTest-843130989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 /opt/stack/data/cinder/conversion/6731ffca-0d0c-4980-8268-337ec90c5633.temp_image.14edd4af-ff75-45e7-900f-652c08820cc08nqxzikp.img {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:57 devstack sudo[98369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 /opt/stack/data/cinder/conversion/6731ffca-0d0c-4980-8268-337ec90c5633.temp_image.14edd4af-ff75-45e7-900f-652c08820cc08nqxzikp.img Jul 08 14:38:57 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:58 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Jul 08 14:38:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5ce380d7-e27e-4d2d-b530-bb1c13aad35c tempest-SnapshotMetadataTestJSON-1440965292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.17296137-81fb-4d8d-893e-5ce7ab6e84dd" returned: 0 in 0.879s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:38:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5ce380d7-e27e-4d2d-b530-bb1c13aad35c tempest-SnapshotMetadataTestJSON-1440965292 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:38:58 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93e51a9-011c-4751-bbbf-3efec17708ae]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:38:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5ce380d7-e27e-4d2d-b530-bb1c13aad35c tempest-SnapshotMetadataTestJSON-1440965292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:58 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8 Jul 08 14:38:58 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:38:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:38:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:38:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:38:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:38:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:38:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:38:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:38:59 devstack sudo[98386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:38:59 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:01 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5ce380d7-e27e-4d2d-b530-bb1c13aad35c tempest-SnapshotMetadataTestJSON-1440965292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8" returned: 0 in 2.503s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5ce380d7-e27e-4d2d-b530-bb1c13aad35c tempest-SnapshotMetadataTestJSON-1440965292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.17296137-81fb-4d8d-893e-5ce7ab6e84dd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:01 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.17296137-81fb-4d8d-893e-5ce7ab6e84dd Jul 08 14:39:01 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:01 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.871s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:01 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:39:01 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:39:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:39:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:39:03 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5ce380d7-e27e-4d2d-b530-bb1c13aad35c tempest-SnapshotMetadataTestJSON-1440965292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.17296137-81fb-4d8d-893e-5ce7ab6e84dd" returned: 0 in 2.452s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5ce380d7-e27e-4d2d-b530-bb1c13aad35c tempest-SnapshotMetadataTestJSON-1440965292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.17296137-81fb-4d8d-893e-5ce7ab6e84dd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:03 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.17296137-81fb-4d8d-893e-5ce7ab6e84dd Jul 08 14:39:03 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:03 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7b622f8b-eb9a-4e59-92bd-bc85c4cfa1bd tempest-VolumesActionsTest-843130989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 /opt/stack/data/cinder/conversion/6731ffca-0d0c-4980-8268-337ec90c5633.temp_image.14edd4af-ff75-45e7-900f-652c08820cc08nqxzikp.img" returned: 0 in 5.910s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:03 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[426b249f-b4e2-4293-9f5c-d36b6c91fb90]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7b622f8b-eb9a-4e59-92bd-bc85c4cfa1bd tempest-VolumesActionsTest-843130989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:03 devstack sudo[98403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 Jul 08 14:39:03 devstack sudo[98403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:04 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5ce380d7-e27e-4d2d-b530-bb1c13aad35c tempest-SnapshotMetadataTestJSON-1440965292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8.17296137-81fb-4d8d-893e-5ce7ab6e84dd" returned: 0 in 0.983s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5ce380d7-e27e-4d2d-b530-bb1c13aad35c tempest-SnapshotMetadataTestJSON-1440965292 None] Lock "cinder-quobyte-17296137-81fb-4d8d-893e-5ce7ab6e84dd" released by "_delete_snapshot" :: held 6.978s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:39:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5ce380d7-e27e-4d2d-b530-bb1c13aad35c tempest-SnapshotMetadataTestJSON-1440965292 None] Lock "cinder-quobyte-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8" released by "delete_snapshot" :: held 7.002s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:39:04 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-5ce380d7-e27e-4d2d-b530-bb1c13aad35c tempest-SnapshotMetadataTestJSON-1440965292 None] Created reservations ['c68ff268-eacf-4b71-8e0d-00bb9c05090d', '30aa5c8c-0232-4ae6-8060-e6763438ff26', 'fe75b325-6e2f-4847-b628-fdd59796061a', '146d9c89-afa9-4e1b-8a03-32cf4ac1aa6f'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:39:04 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5ce380d7-e27e-4d2d-b530-bb1c13aad35c tempest-SnapshotMetadataTestJSON-1440965292 None] Delete snapshot completed successfully. Jul 08 14:39:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5ce380d7-e27e-4d2d-b530-bb1c13aad35c tempest-SnapshotMetadataTestJSON-1440965292 None] Lock "cinder-17296137-81fb-4d8d-893e-5ce7ab6e84dd-delete_snapshot" released by "delete_snapshot" :: held 7.172s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:39:04 devstack sudo[98403]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7b622f8b-eb9a-4e59-92bd-bc85c4cfa1bd tempest-VolumesActionsTest-843130989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633" returned: 0 in 1.217s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:04 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-7b622f8b-eb9a-4e59-92bd-bc85c4cfa1bd tempest-VolumesActionsTest-843130989 None] Image conversion details: src /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633, size 1024.00 MB, duration 5.91 sec, destination /opt/stack/data/cinder/conversion/6731ffca-0d0c-4980-8268-337ec90c5633.temp_image.14edd4af-ff75-45e7-900f-652c08820cc08nqxzikp.img {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:39:04 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-7b622f8b-eb9a-4e59-92bd-bc85c4cfa1bd tempest-VolumesActionsTest-843130989 None] Converted 1024.00 MB image at 173.23 MB/s Jul 08 14:39:04 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-7b622f8b-eb9a-4e59-92bd-bc85c4cfa1bd tempest-VolumesActionsTest-843130989 None] 14edd4af-ff75-45e7-900f-652c08820cc0 was raw, no need to convert to raw {{(pid=87240) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 08 14:39:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ed5103c0-2b53-43e7-9fd2-136dcbf755d4 tempest-SnapshotMetadataTestJSON-1440965292 None] Acquiring lock "cinder-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:39:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ed5103c0-2b53-43e7-9fd2-136dcbf755d4 tempest-SnapshotMetadataTestJSON-1440965292 None] Lock "cinder-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:39:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ed5103c0-2b53-43e7-9fd2-136dcbf755d4 tempest-SnapshotMetadataTestJSON-1440965292 None] Acquiring lock "cinder-quobyte-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:39:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ed5103c0-2b53-43e7-9fd2-136dcbf755d4 tempest-SnapshotMetadataTestJSON-1440965292 None] Lock "cinder-quobyte-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:39:05 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[939cc12d-ee5b-4fa2-9ec6-ca863d502eb7]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ed5103c0-2b53-43e7-9fd2-136dcbf755d4 tempest-SnapshotMetadataTestJSON-1440965292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:05 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8 Jul 08 14:39:05 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:06 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ed5103c0-2b53-43e7-9fd2-136dcbf755d4 tempest-SnapshotMetadataTestJSON-1440965292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8" returned: 0 in 1.053s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ed5103c0-2b53-43e7-9fd2-136dcbf755d4 tempest-SnapshotMetadataTestJSON-1440965292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:06 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8 Jul 08 14:39:06 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:07 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ed5103c0-2b53-43e7-9fd2-136dcbf755d4 tempest-SnapshotMetadataTestJSON-1440965292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8" returned: 0 in 0.860s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ed5103c0-2b53-43e7-9fd2-136dcbf755d4 tempest-SnapshotMetadataTestJSON-1440965292 None] Lock "cinder-quobyte-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8" released by "delete_volume" :: held 2.007s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:39:07 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=73,cinder:UPDATE=99,cinder:INSERT=27,cinder:DELETE=10 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:39:07 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:INSERT=19,cinder:SELECT=103,cinder:UPDATE=92,cinder:DELETE=4 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:39:07 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-ed5103c0-2b53-43e7-9fd2-136dcbf755d4 tempest-SnapshotMetadataTestJSON-1440965292 None] Created reservations ['aee51a9b-6de1-4b16-a1b9-db3b92eadea8', '2116f36a-1592-4f02-b201-3427b37a2888', '9eebc876-2083-4f1e-aa4a-eed378ff5ada', '23b9a850-ef8a-4a15-a11c-92c0183a91df'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:39:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ed5103c0-2b53-43e7-9fd2-136dcbf755d4 tempest-SnapshotMetadataTestJSON-1440965292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ed5103c0-2b53-43e7-9fd2-136dcbf755d4 tempest-SnapshotMetadataTestJSON-1440965292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ed5103c0-2b53-43e7-9fd2-136dcbf755d4 tempest-SnapshotMetadataTestJSON-1440965292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:39:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ed5103c0-2b53-43e7-9fd2-136dcbf755d4 tempest-SnapshotMetadataTestJSON-1440965292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:39:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ed5103c0-2b53-43e7-9fd2-136dcbf755d4 tempest-SnapshotMetadataTestJSON-1440965292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ed5103c0-2b53-43e7-9fd2-136dcbf755d4 tempest-SnapshotMetadataTestJSON-1440965292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:07 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:39:07 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:08 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ed5103c0-2b53-43e7-9fd2-136dcbf755d4 tempest-SnapshotMetadataTestJSON-1440965292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.699s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:08 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-ed5103c0-2b53-43e7-9fd2-136dcbf755d4 tempest-SnapshotMetadataTestJSON-1440965292 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:39:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ed5103c0-2b53-43e7-9fd2-136dcbf755d4 tempest-SnapshotMetadataTestJSON-1440965292 None] Deleted volume successfully. Jul 08 14:39:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ed5103c0-2b53-43e7-9fd2-136dcbf755d4 tempest-SnapshotMetadataTestJSON-1440965292 None] Lock "cinder-1ee8300c-ec4c-4e3d-a5f6-465d16827fe8-delete_volume" released by "delete_volume" :: held 3.046s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:39:15 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:39:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Flow 'volume_create_manager' (c977e0a2-5b30-4e84-a92d-940c2b249ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:39:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c4f4fc-2139-417a-84e6-b407c5d32287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c4f4fc-2139-417a-84e6-b407c5d32287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1127199592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c16290b-67ad-449c-819a-3c57ec474c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e26674c0b64348bd80fb1d85f96b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:39:15Z,use_quota=True,user_id='59a69ee7b0354bd7abdab19d6b693c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddd4e5b-ced3-4ab7-b476-fd64c57503c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddd4e5b-ced3-4ab7-b476-fd64c57503c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d0058bd-93e4-4ba8-8f35-53e35bfc5e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d0058bd-93e4-4ba8-8f35-53e35bfc5e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c16290b-67ad-449c-819a-3c57ec474c07', 'volume_name': 'volume-9c16290b-67ad-449c-819a-3c57ec474c07', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5bf953-c444-4a91-8d2c-5cffb5731d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d5bf953-c444-4a91-8d2c-5cffb5731d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98d6de6-21de-48d3-b702-cd2e63028391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:15 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Volume 9c16290b-67ad-449c-819a-3c57ec474c07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c16290b-67ad-449c-819a-3c57ec474c07', 'volume_size': 1} Jul 08 14:39:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:25 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:39:25 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:INSERT=2,cinder:UPDATE=8,cinder:SELECT=3 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:39:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7b622f8b-eb9a-4e59-92bd-bc85c4cfa1bd tempest-VolumesActionsTest-843130989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.212s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7b622f8b-eb9a-4e59-92bd-bc85c4cfa1bd tempest-VolumesActionsTest-843130989 None] Uploaded volume to glance image-id: 14edd4af-ff75-45e7-900f-652c08820cc0. {{(pid=87240) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 14:39:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 33.003s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1881577372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53c7a91d-1413-47d1-9ac9-c48b4d109515,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='509714aefe954128b5dec04a87501c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:38:53Z,use_quota=True,user_id='9a8cf2cb7fbb4815b757605be1cdf44f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:39:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Creating volume 53c7a91d-1413-47d1-9ac9-c48b4d109515 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:39:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:39:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:39:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:39:26 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:39:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-53c7a91d-1413-47d1-9ac9-c48b4d109515 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:26 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-53c7a91d-1413-47d1-9ac9-c48b4d109515 1073741824 Jul 08 14:39:26 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7b622f8b-eb9a-4e59-92bd-bc85c4cfa1bd tempest-VolumesActionsTest-843130989 None] Copy volume to image completed successfully. Jul 08 14:39:27 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-53c7a91d-1413-47d1-9ac9-c48b4d109515 1073741824" returned: 0 in 0.895s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-53c7a91d-1413-47d1-9ac9-c48b4d109515 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:27 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-53c7a91d-1413-47d1-9ac9-c48b4d109515 Jul 08 14:39:27 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:27 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-53c7a91d-1413-47d1-9ac9-c48b4d109515" returned: 0 in 0.714s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:39:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.213s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:39:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1127199592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c16290b-67ad-449c-819a-3c57ec474c07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e26674c0b64348bd80fb1d85f96b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:39:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:39:15Z,use_quota=True,user_id='59a69ee7b0354bd7abdab19d6b693c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:39:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Creating volume 9c16290b-67ad-449c-819a-3c57ec474c07 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:39:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:39:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:39:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:39:27 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:39:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:27 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07 1073741824 Jul 08 14:39:27 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e73085c-b6ca-4a59-abfd-ab3798acb908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53c7a91d-1413-47d1-9ac9-c48b4d109515', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52926783-f71f-4440-b9c1-c9cc8444a7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:27 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Volume volume-53c7a91d-1413-47d1-9ac9-c48b4d109515 (53c7a91d-1413-47d1-9ac9-c48b4d109515): created successfully Jul 08 14:39:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52926783-f71f-4440-b9c1-c9cc8444a7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Flow 'volume_create_manager' (2d0ff981-762d-4cf1-a418-e1983c582983) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:39:28 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ab4fb34d-7439-4856-a121-713aabeb25c8 tempest-VolumesTestJSON-263628317 None] Created volume successfully. Jul 08 14:39:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:28 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07 1073741824" returned: 0 in 0.889s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:28 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07 Jul 08 14:39:28 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:29 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07" returned: 0 in 0.731s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:39:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.437s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98d6de6-21de-48d3-b702-cd2e63028391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c16290b-67ad-449c-819a-3c57ec474c07', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (810ebd13-4b71-45a0-b8a1-5eccd3a62628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:29 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[15936bb2-9146-4770-abe0-1d00c7a8e224]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:29 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Volume volume-9c16290b-67ad-449c-819a-3c57ec474c07 (9c16290b-67ad-449c-819a-3c57ec474c07): created successfully Jul 08 14:39:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (810ebd13-4b71-45a0-b8a1-5eccd3a62628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Flow 'volume_create_manager' (c977e0a2-5b30-4e84-a92d-940c2b249ab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:39:29 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-097ca9b9-40e8-4e46-8223-21a4c8f826c3 tempest-VolumesDeleteCascade-1443573958 None] Created volume successfully. Jul 08 14:39:29 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 Jul 08 14:39:29 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:29 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:39:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Flow 'volume_create_manager' (e3f3d58b-fb9f-408f-a7c3-ee72bf08f331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:39:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8c3f9e-a78e-4776-a9d0-101b9982ef8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8c3f9e-a78e-4776-a9d0-101b9982ef8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-92373749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e99e0bb3-ec92-49c6-aac5-e20a6c312b22,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='509714aefe954128b5dec04a87501c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:39:30Z,use_quota=True,user_id='9a8cf2cb7fbb4815b757605be1cdf44f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4812e6ba-2c48-485c-8a88-89fd9dd9f35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4812e6ba-2c48-485c-8a88-89fd9dd9f35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951ba62e-9b81-4fba-ace9-4b3c504cc5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951ba62e-9b81-4fba-ace9-4b3c504cc5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e99e0bb3-ec92-49c6-aac5-e20a6c312b22', 'volume_name': 'volume-e99e0bb3-ec92-49c6-aac5-e20a6c312b22', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170d469c-775d-4cba-8016-8a35226baf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (170d469c-775d-4cba-8016-8a35226baf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39b13e7-c631-428a-ab52-3b4a0ad44feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:29 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Volume e99e0bb3-ec92-49c6-aac5-e20a6c312b22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e99e0bb3-ec92-49c6-aac5-e20a6c312b22', 'volume_size': 1} Jul 08 14:39:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:30 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633" returned: 0 in 0.819s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:30 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4242dba-f088-4585-8a49-b618cdecc3b2]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:30 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 Jul 08 14:39:30 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-40a08fbf-b2ff-49fd-b29a-391bd0b4bbb5 tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:31 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633" returned: 0 in 0.814s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 /opt/stack/data/cinder/conversion/6731ffca-0d0c-4980-8268-337ec90c5633.temp_image.47cd2fe6-bdca-44fe-b657-9b0c98c7f0d82ps5tci_.img {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:31 devstack sudo[98453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 /opt/stack/data/cinder/conversion/6731ffca-0d0c-4980-8268-337ec90c5633.temp_image.47cd2fe6-bdca-44fe-b657-9b0c98c7f0d82ps5tci_.img Jul 08 14:39:31 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:35 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 /opt/stack/data/cinder/conversion/6731ffca-0d0c-4980-8268-337ec90c5633.temp_image.47cd2fe6-bdca-44fe-b657-9b0c98c7f0d82ps5tci_.img" returned: 0 in 4.635s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:35 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1902d12e-308b-404a-acfe-fe2997ebfb05]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:35 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 Jul 08 14:39:35 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:36 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633" returned: 0 in 0.965s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:36 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] Image conversion details: src /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633, size 1024.00 MB, duration 4.64 sec, destination /opt/stack/data/cinder/conversion/6731ffca-0d0c-4980-8268-337ec90c5633.temp_image.47cd2fe6-bdca-44fe-b657-9b0c98c7f0d82ps5tci_.img {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:39:36 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] Converted 1024.00 MB image at 220.89 MB/s Jul 08 14:39:36 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] 47cd2fe6-bdca-44fe-b657-9b0c98c7f0d8 was raw, converting to qcow2 {{(pid=87240) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 08 14:39:36 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5316b6a3-830d-43e8-b9d5-00d9a1def8ff]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6731ffca-0d0c-4980-8268-337ec90c5633.temp_image.47cd2fe6-bdca-44fe-b657-9b0c98c7f0d82ps5tci_.img {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:36 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6731ffca-0d0c-4980-8268-337ec90c5633.temp_image.47cd2fe6-bdca-44fe-b657-9b0c98c7f0d82ps5tci_.img Jul 08 14:39:36 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:37 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6731ffca-0d0c-4980-8268-337ec90c5633.temp_image.47cd2fe6-bdca-44fe-b657-9b0c98c7f0d82ps5tci_.img" returned: 0 in 0.808s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6731ffca-0d0c-4980-8268-337ec90c5633.temp_image.47cd2fe6-bdca-44fe-b657-9b0c98c7f0d82ps5tci_.img {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:37 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6731ffca-0d0c-4980-8268-337ec90c5633.temp_image.47cd2fe6-bdca-44fe-b657-9b0c98c7f0d82ps5tci_.img Jul 08 14:39:37 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:38 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6731ffca-0d0c-4980-8268-337ec90c5633.temp_image.47cd2fe6-bdca-44fe-b657-9b0c98c7f0d82ps5tci_.img" returned: 1 in 0.755s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6731ffca-0d0c-4980-8268-337ec90c5633.temp_image.47cd2fe6-bdca-44fe-b657-9b0c98c7f0d82ps5tci_.img' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:39:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6731ffca-0d0c-4980-8268-337ec90c5633.temp_image.47cd2fe6-bdca-44fe-b657-9b0c98c7f0d82ps5tci_.img /opt/stack/data/cinder/conversion/vol_upload_0t62mzzv {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:38 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6731ffca-0d0c-4980-8268-337ec90c5633.temp_image.47cd2fe6-bdca-44fe-b657-9b0c98c7f0d82ps5tci_.img /opt/stack/data/cinder/conversion/vol_upload_0t62mzzv Jul 08 14:39:38 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:39 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6731ffca-0d0c-4980-8268-337ec90c5633.temp_image.47cd2fe6-bdca-44fe-b657-9b0c98c7f0d82ps5tci_.img /opt/stack/data/cinder/conversion/vol_upload_0t62mzzv" returned: 0 in 0.707s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:39 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] Image conversion details: src /opt/stack/data/cinder/conversion/6731ffca-0d0c-4980-8268-337ec90c5633.temp_image.47cd2fe6-bdca-44fe-b657-9b0c98c7f0d82ps5tci_.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_0t62mzzv {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:39:39 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 08 14:39:39 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba610b8-d4d6-420a-b1cc-96bee560a0d6]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_0t62mzzv {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:39 devstack sudo[98485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_0t62mzzv Jul 08 14:39:39 devstack sudo[98485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:39 devstack sudo[98485]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_0t62mzzv" returned: 0 in 0.756s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:40 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=7,cinder:UPDATE=4 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:39:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.824s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] Uploaded volume to glance image-id: 47cd2fe6-bdca-44fe-b657-9b0c98c7f0d8. {{(pid=87240) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 14:39:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.549s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-92373749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e99e0bb3-ec92-49c6-aac5-e20a6c312b22,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='509714aefe954128b5dec04a87501c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:39:30Z,use_quota=True,user_id='9a8cf2cb7fbb4815b757605be1cdf44f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:39:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Creating volume e99e0bb3-ec92-49c6-aac5-e20a6c312b22 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:39:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:39:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:39:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:39:41 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:39:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e99e0bb3-ec92-49c6-aac5-e20a6c312b22 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:41 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e99e0bb3-ec92-49c6-aac5-e20a6c312b22 1073741824 Jul 08 14:39:41 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:41 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4236cd7e-6c4b-4cc6-bc9f-e44575d77e9b tempest-VolumesActionsTest-843130989 None] Copy volume to image completed successfully. Jul 08 14:39:42 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e99e0bb3-ec92-49c6-aac5-e20a6c312b22 1073741824" returned: 0 in 0.881s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e99e0bb3-ec92-49c6-aac5-e20a6c312b22 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:42 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e99e0bb3-ec92-49c6-aac5-e20a6c312b22 Jul 08 14:39:42 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7e585667-4a00-49a8-8cfb-05407d501e95 tempest-VolumesActionsTest-843130989 None] Acquiring lock "cinder-6731ffca-0d0c-4980-8268-337ec90c5633-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:39:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7e585667-4a00-49a8-8cfb-05407d501e95 tempest-VolumesActionsTest-843130989 None] Lock "cinder-6731ffca-0d0c-4980-8268-337ec90c5633-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:39:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7e585667-4a00-49a8-8cfb-05407d501e95 tempest-VolumesActionsTest-843130989 None] Acquiring lock "cinder-quobyte-6731ffca-0d0c-4980-8268-337ec90c5633" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:39:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7e585667-4a00-49a8-8cfb-05407d501e95 tempest-VolumesActionsTest-843130989 None] Lock "cinder-quobyte-6731ffca-0d0c-4980-8268-337ec90c5633" acquired by "delete_volume" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:39:42 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62a5195-d057-451a-9288-38eccd94b9c0]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e585667-4a00-49a8-8cfb-05407d501e95 tempest-VolumesActionsTest-843130989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:42 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 Jul 08 14:39:42 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:43 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e99e0bb3-ec92-49c6-aac5-e20a6c312b22" returned: 0 in 0.775s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] <== create_volume: return (1719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:39:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-40a08fbf-b2ff-49fd-b29a-391bd0b4bbb5 tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.488s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-40a08fbf-b2ff-49fd-b29a-391bd0b4bbb5 tempest-VolumesDeleteCascade-1443573958 None] Creating offline snapshot 93cd3768-bac9-40a2-bd93-fb8f466efc49 of volume 9c16290b-67ad-449c-819a-3c57ec474c07 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:39:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39b13e7-c631-428a-ab52-3b4a0ad44feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e99e0bb3-ec92-49c6-aac5-e20a6c312b22', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fdfc69-931d-49ff-bc55-262a811dd09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:43 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7175a1-e7dd-4784-ad93-d03ba1b33692]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-40a08fbf-b2ff-49fd-b29a-391bd0b4bbb5 tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:43 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Volume volume-e99e0bb3-ec92-49c6-aac5-e20a6c312b22 (e99e0bb3-ec92-49c6-aac5-e20a6c312b22): created successfully Jul 08 14:39:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9fdfc69-931d-49ff-bc55-262a811dd09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:43 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Flow 'volume_create_manager' (e3f3d58b-fb9f-408f-a7c3-ee72bf08f331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:39:43 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a4ccdfae-8fc3-41bd-b9c1-828d082bef7e tempest-VolumesTestJSON-263628317 None] Created volume successfully. Jul 08 14:39:43 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07 Jul 08 14:39:43 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:43 devstack sudo[98498]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e585667-4a00-49a8-8cfb-05407d501e95 tempest-VolumesActionsTest-843130989 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633" returned: 0 in 0.865s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e585667-4a00-49a8-8cfb-05407d501e95 tempest-VolumesActionsTest-843130989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:43 devstack sudo[98506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633 Jul 08 14:39:43 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:44 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-40a08fbf-b2ff-49fd-b29a-391bd0b4bbb5 tempest-VolumesDeleteCascade-1443573958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07" returned: 0 in 0.933s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-40a08fbf-b2ff-49fd-b29a-391bd0b4bbb5 tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:44 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49 1G Jul 08 14:39:44 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:44 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e585667-4a00-49a8-8cfb-05407d501e95 tempest-VolumesActionsTest-843130989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6731ffca-0d0c-4980-8268-337ec90c5633" returned: 0 in 0.806s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7e585667-4a00-49a8-8cfb-05407d501e95 tempest-VolumesActionsTest-843130989 None] Lock "cinder-quobyte-6731ffca-0d0c-4980-8268-337ec90c5633" released by "delete_volume" :: held 1.742s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:39:44 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-7e585667-4a00-49a8-8cfb-05407d501e95 tempest-VolumesActionsTest-843130989 None] Created reservations ['b40e8fd0-1d6a-4c7a-9bf0-d3b20950db63', 'f52dad47-4732-4b60-bfd9-3a648d84e3ad', '96f516ca-20f5-46d8-9f59-495ebf3fc739', '1b6b6b53-4972-4d14-9164-1fac2497ba64'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:39:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7e585667-4a00-49a8-8cfb-05407d501e95 tempest-VolumesActionsTest-843130989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7e585667-4a00-49a8-8cfb-05407d501e95 tempest-VolumesActionsTest-843130989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7e585667-4a00-49a8-8cfb-05407d501e95 tempest-VolumesActionsTest-843130989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:39:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7e585667-4a00-49a8-8cfb-05407d501e95 tempest-VolumesActionsTest-843130989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:39:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7e585667-4a00-49a8-8cfb-05407d501e95 tempest-VolumesActionsTest-843130989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e585667-4a00-49a8-8cfb-05407d501e95 tempest-VolumesActionsTest-843130989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:44 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:39:44 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:39:44 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Flow 'volume_create_manager' (d676cf43-a79b-4d26-b3f6-69064b8ac932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:39:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e5b0347-3c30-4da1-8338-b708cea24d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e5b0347-3c30-4da1-8338-b708cea24d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1796130569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212a34fc-f009-4427-919b-3db80959b0d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='509714aefe954128b5dec04a87501c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:39:44Z,use_quota=True,user_id='9a8cf2cb7fbb4815b757605be1cdf44f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dccf19e9-4885-4ce0-bc36-5a2e6ff2e3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dccf19e9-4885-4ce0-bc36-5a2e6ff2e3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad698308-0b73-458f-837f-4f91acba6f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad698308-0b73-458f-837f-4f91acba6f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '212a34fc-f009-4427-919b-3db80959b0d5', 'volume_name': 'volume-212a34fc-f009-4427-919b-3db80959b0d5', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e44c484-db96-488c-9a42-16b6e491540a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e44c484-db96-488c-9a42-16b6e491540a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da74edff-5ffd-421e-98b6-0b565b55d49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:44 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Volume 212a34fc-f009-4427-919b-3db80959b0d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-212a34fc-f009-4427-919b-3db80959b0d5', 'volume_size': 1} Jul 08 14:39:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:45 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-40a08fbf-b2ff-49fd-b29a-391bd0b4bbb5 tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49 1G" returned: 0 in 1.233s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-40a08fbf-b2ff-49fd-b29a-391bd0b4bbb5 tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c16290b-67ad-449c-819a-3c57ec474c07 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:45 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:45 devstack sudo[98557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c16290b-67ad-449c-819a-3c57ec474c07 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49 Jul 08 14:39:45 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7e585667-4a00-49a8-8cfb-05407d501e95 tempest-VolumesActionsTest-843130989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.827s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:45 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-7e585667-4a00-49a8-8cfb-05407d501e95 tempest-VolumesActionsTest-843130989 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:39:45 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7e585667-4a00-49a8-8cfb-05407d501e95 tempest-VolumesActionsTest-843130989 None] Deleted volume successfully. Jul 08 14:39:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7e585667-4a00-49a8-8cfb-05407d501e95 tempest-VolumesActionsTest-843130989 None] Lock "cinder-6731ffca-0d0c-4980-8268-337ec90c5633-delete_volume" released by "delete_volume" :: held 2.948s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:39:46 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-40a08fbf-b2ff-49fd-b29a-391bd0b4bbb5 tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c16290b-67ad-449c-819a-3c57ec474c07 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49" returned: 0 in 0.780s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:46 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-40a08fbf-b2ff-49fd-b29a-391bd0b4bbb5 tempest-VolumesDeleteCascade-1443573958 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49 is being set with open permissions: ugo+rw Jul 08 14:39:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-40a08fbf-b2ff-49fd-b29a-391bd0b4bbb5 tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:46 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49 Jul 08 14:39:46 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:46 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-40a08fbf-b2ff-49fd-b29a-391bd0b4bbb5 tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49" returned: 0 in 0.689s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-40a08fbf-b2ff-49fd-b29a-391bd0b4bbb5 tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:46 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.info Jul 08 14:39:46 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:47 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-40a08fbf-b2ff-49fd-b29a-391bd0b4bbb5 tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.info" returned: 0 in 0.706s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:47 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-40a08fbf-b2ff-49fd-b29a-391bd0b4bbb5 tempest-VolumesDeleteCascade-1443573958 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.info is being set with open permissions: ugo+rw Jul 08 14:39:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-40a08fbf-b2ff-49fd-b29a-391bd0b4bbb5 tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:47 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.info Jul 08 14:39:47 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:48 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-40a08fbf-b2ff-49fd-b29a-391bd0b4bbb5 tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.info" returned: 0 in 0.706s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-40a08fbf-b2ff-49fd-b29a-391bd0b4bbb5 tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.168s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.468s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1796130569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212a34fc-f009-4427-919b-3db80959b0d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='509714aefe954128b5dec04a87501c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:39:44Z,use_quota=True,user_id='9a8cf2cb7fbb4815b757605be1cdf44f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:39:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Creating volume 212a34fc-f009-4427-919b-3db80959b0d5 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:39:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:39:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:39:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:39:48 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:39:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-212a34fc-f009-4427-919b-3db80959b0d5 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:48 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-212a34fc-f009-4427-919b-3db80959b0d5 1073741824 Jul 08 14:39:48 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:48 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-40a08fbf-b2ff-49fd-b29a-391bd0b4bbb5 tempest-VolumesDeleteCascade-1443573958 None] Create snapshot completed successfully Jul 08 14:39:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7ead1147-247c-42a6-91b8-9378918950ea tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:49 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-212a34fc-f009-4427-919b-3db80959b0d5 1073741824" returned: 0 in 1.066s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-212a34fc-f009-4427-919b-3db80959b0d5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:49 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-212a34fc-f009-4427-919b-3db80959b0d5 Jul 08 14:39:49 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:50 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-212a34fc-f009-4427-919b-3db80959b0d5" returned: 0 in 0.773s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:39:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7ead1147-247c-42a6-91b8-9378918950ea tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.480s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da74edff-5ffd-421e-98b6-0b565b55d49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-212a34fc-f009-4427-919b-3db80959b0d5', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b1453e-52f9-4d93-a72f-e958ce9468f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-7ead1147-247c-42a6-91b8-9378918950ea tempest-VolumesDeleteCascade-1443573958 None] Creating offline snapshot a4b62144-56dd-4943-8f78-2fcc24e1ecb4 of volume 9c16290b-67ad-449c-819a-3c57ec474c07 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:39:50 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Volume volume-212a34fc-f009-4427-919b-3db80959b0d5 (212a34fc-f009-4427-919b-3db80959b0d5): created successfully Jul 08 14:39:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b1453e-52f9-4d93-a72f-e958ce9468f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Flow 'volume_create_manager' (d676cf43-a79b-4d26-b3f6-69064b8ac932) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:39:50 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[840dd057-c7d8-4f41-9aba-a07f339fa2b6]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7ead1147-247c-42a6-91b8-9378918950ea tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-680f4d42-2324-485d-a56b-e6db836974d3 tempest-VolumesTestJSON-263628317 None] Created volume successfully. Jul 08 14:39:50 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49 Jul 08 14:39:50 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:51 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7ead1147-247c-42a6-91b8-9378918950ea tempest-VolumesDeleteCascade-1443573958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49" returned: 0 in 0.922s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-7ead1147-247c-42a6-91b8-9378918950ea tempest-VolumesDeleteCascade-1443573958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c16290b-67ad-449c-819a-3c57ec474c07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:39:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7ead1147-247c-42a6-91b8-9378918950ea tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:51 devstack sudo[98590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4 1G Jul 08 14:39:51 devstack sudo[98590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:51 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:39:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Flow 'volume_create_manager' (9b1cfcef-5443-4fb4-bb66-4a005fc75f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:39:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6f704b-56da-4b2c-8ec1-c442ad279ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6f704b-56da-4b2c-8ec1-c442ad279ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-64435165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1668ad5-92bf-4fc3-a163-e729d79d9dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef16addb7cff48f98fada7ae262f1e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:39:52Z,use_quota=True,user_id='3aaada860a99499e93543db9a500c99e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f99a8ea-41c6-40d4-8f12-f43f111aa63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f99a8ea-41c6-40d4-8f12-f43f111aa63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64cb9cd5-1505-4ef8-98c1-3656655b4297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64cb9cd5-1505-4ef8-98c1-3656655b4297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1668ad5-92bf-4fc3-a163-e729d79d9dcb', 'volume_name': 'volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb34488c-a2eb-4ae2-a39b-ae40ccd57ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb34488c-a2eb-4ae2-a39b-ae40ccd57ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4199e434-ac37-483b-991c-cc13c1c06c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:51 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Volume a1668ad5-92bf-4fc3-a163-e729d79d9dcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb', 'volume_size': 1} Jul 08 14:39:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2f4ef502-5ca0-4502-8f6f-d4948de51fb3 tempest-VolumesTestJSON-263628317 None] Acquiring lock "cinder-212a34fc-f009-4427-919b-3db80959b0d5-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:39:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2f4ef502-5ca0-4502-8f6f-d4948de51fb3 tempest-VolumesTestJSON-263628317 None] Lock "cinder-212a34fc-f009-4427-919b-3db80959b0d5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:39:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2f4ef502-5ca0-4502-8f6f-d4948de51fb3 tempest-VolumesTestJSON-263628317 None] Acquiring lock "cinder-quobyte-212a34fc-f009-4427-919b-3db80959b0d5" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:39:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2f4ef502-5ca0-4502-8f6f-d4948de51fb3 tempest-VolumesTestJSON-263628317 None] Lock "cinder-quobyte-212a34fc-f009-4427-919b-3db80959b0d5" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:39:52 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8695ba-f1c2-4f07-a4ab-64546fd7d319]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2f4ef502-5ca0-4502-8f6f-d4948de51fb3 tempest-VolumesTestJSON-263628317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-212a34fc-f009-4427-919b-3db80959b0d5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:52 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-212a34fc-f009-4427-919b-3db80959b0d5 Jul 08 14:39:52 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:52 devstack sudo[98590]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7ead1147-247c-42a6-91b8-9378918950ea tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4 1G" returned: 0 in 1.202s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7ead1147-247c-42a6-91b8-9378918950ea tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:52 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4 Jul 08 14:39:52 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:53 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2f4ef502-5ca0-4502-8f6f-d4948de51fb3 tempest-VolumesTestJSON-263628317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-212a34fc-f009-4427-919b-3db80959b0d5" returned: 0 in 0.835s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2f4ef502-5ca0-4502-8f6f-d4948de51fb3 tempest-VolumesTestJSON-263628317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-212a34fc-f009-4427-919b-3db80959b0d5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:53 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-212a34fc-f009-4427-919b-3db80959b0d5 Jul 08 14:39:53 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:53 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7ead1147-247c-42a6-91b8-9378918950ea tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4" returned: 0 in 0.798s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:53 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-7ead1147-247c-42a6-91b8-9378918950ea tempest-VolumesDeleteCascade-1443573958 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4 is being set with open permissions: ugo+rw Jul 08 14:39:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7ead1147-247c-42a6-91b8-9378918950ea tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:53 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4 Jul 08 14:39:53 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:53 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2f4ef502-5ca0-4502-8f6f-d4948de51fb3 tempest-VolumesTestJSON-263628317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-212a34fc-f009-4427-919b-3db80959b0d5" returned: 0 in 0.754s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2f4ef502-5ca0-4502-8f6f-d4948de51fb3 tempest-VolumesTestJSON-263628317 None] Lock "cinder-quobyte-212a34fc-f009-4427-919b-3db80959b0d5" released by "delete_volume" :: held 1.644s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:39:53 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7ead1147-247c-42a6-91b8-9378918950ea tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4" returned: 0 in 0.714s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:53 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-2f4ef502-5ca0-4502-8f6f-d4948de51fb3 tempest-VolumesTestJSON-263628317 None] Created reservations ['8c03a82c-2027-43b9-9881-6a6b2a2045fa', '9c6c3406-99fd-4e3d-b1ac-770a86802e4d', '360be30c-297a-436c-ba72-312afee0c72e', '17143585-3fd2-470f-8120-265751ca352a'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:39:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7ead1147-247c-42a6-91b8-9378918950ea tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.789s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.045s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-64435165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1668ad5-92bf-4fc3-a163-e729d79d9dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef16addb7cff48f98fada7ae262f1e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:39:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:39:52Z,use_quota=True,user_id='3aaada860a99499e93543db9a500c99e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:39:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Creating volume a1668ad5-92bf-4fc3-a163-e729d79d9dcb {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:39:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:39:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:39:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:39:53 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:39:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:53 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb 1073741824 Jul 08 14:39:53 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:53 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7ead1147-247c-42a6-91b8-9378918950ea tempest-VolumesDeleteCascade-1443573958 None] Create snapshot completed successfully Jul 08 14:39:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2f4ef502-5ca0-4502-8f6f-d4948de51fb3 tempest-VolumesTestJSON-263628317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2f4ef502-5ca0-4502-8f6f-d4948de51fb3 tempest-VolumesTestJSON-263628317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2f4ef502-5ca0-4502-8f6f-d4948de51fb3 tempest-VolumesTestJSON-263628317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:39:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2f4ef502-5ca0-4502-8f6f-d4948de51fb3 tempest-VolumesTestJSON-263628317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:39:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2f4ef502-5ca0-4502-8f6f-d4948de51fb3 tempest-VolumesTestJSON-263628317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2f4ef502-5ca0-4502-8f6f-d4948de51fb3 tempest-VolumesTestJSON-263628317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:54 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:39:54 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50fcd936-78f6-487f-a844-c5d49083bf63 tempest-VolumesTestJSON-263628317 None] Acquiring lock "cinder-e99e0bb3-ec92-49c6-aac5-e20a6c312b22-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:39:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50fcd936-78f6-487f-a844-c5d49083bf63 tempest-VolumesTestJSON-263628317 None] Lock "cinder-e99e0bb3-ec92-49c6-aac5-e20a6c312b22-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:39:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50fcd936-78f6-487f-a844-c5d49083bf63 tempest-VolumesTestJSON-263628317 None] Acquiring lock "cinder-quobyte-e99e0bb3-ec92-49c6-aac5-e20a6c312b22" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:39:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50fcd936-78f6-487f-a844-c5d49083bf63 tempest-VolumesTestJSON-263628317 None] Lock "cinder-quobyte-e99e0bb3-ec92-49c6-aac5-e20a6c312b22" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:39:54 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0fd57e-2b09-479c-96a9-080027c57493]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50fcd936-78f6-487f-a844-c5d49083bf63 tempest-VolumesTestJSON-263628317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e99e0bb3-ec92-49c6-aac5-e20a6c312b22 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:54 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e99e0bb3-ec92-49c6-aac5-e20a6c312b22 Jul 08 14:39:54 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:54 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2f4ef502-5ca0-4502-8f6f-d4948de51fb3 tempest-VolumesTestJSON-263628317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.878s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:54 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-2f4ef502-5ca0-4502-8f6f-d4948de51fb3 tempest-VolumesTestJSON-263628317 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:39:54 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2f4ef502-5ca0-4502-8f6f-d4948de51fb3 tempest-VolumesTestJSON-263628317 None] Deleted volume successfully. Jul 08 14:39:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2f4ef502-5ca0-4502-8f6f-d4948de51fb3 tempest-VolumesTestJSON-263628317 None] Lock "cinder-212a34fc-f009-4427-919b-3db80959b0d5-delete_volume" released by "delete_volume" :: held 2.854s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "cinder-9c16290b-67ad-449c-819a-3c57ec474c07-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:39:55 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb 1073741824" returned: 0 in 1.118s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-9c16290b-67ad-449c-819a-3c57ec474c07-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Performing cascade delete. {{(pid=87240) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 14:39:55 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb Jul 08 14:39:55 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "cinder-93cd3768-bac9-40a2-bd93-fb8f466efc49-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-93cd3768-bac9-40a2-bd93-fb8f466efc49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "cinder-quobyte-9c16290b-67ad-449c-819a-3c57ec474c07" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-quobyte-9c16290b-67ad-449c-819a-3c57ec474c07" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "cinder-quobyte-93cd3768-bac9-40a2-bd93-fb8f466efc49" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-quobyte-93cd3768-bac9-40a2-bd93-fb8f466efc49" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Deleting offline snapshot 93cd3768-bac9-40a2-bd93-fb8f466efc49 of volume 9c16290b-67ad-449c-819a-3c57ec474c07 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] snapshot_file for this snap is: volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06921d2-c094-4145-ade9-0fa7a539cf05]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:55 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49 Jul 08 14:39:55 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:55 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50fcd936-78f6-487f-a844-c5d49083bf63 tempest-VolumesTestJSON-263628317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e99e0bb3-ec92-49c6-aac5-e20a6c312b22" returned: 0 in 1.050s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50fcd936-78f6-487f-a844-c5d49083bf63 tempest-VolumesTestJSON-263628317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e99e0bb3-ec92-49c6-aac5-e20a6c312b22 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:55 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e99e0bb3-ec92-49c6-aac5-e20a6c312b22 Jul 08 14:39:55 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:55 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb" returned: 0 in 0.777s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.958s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4199e434-ac37-483b-991c-cc13c1c06c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17529de7-059e-4b66-942b-e53f174822db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:55 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Volume volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb (a1668ad5-92bf-4fc3-a163-e729d79d9dcb): created successfully Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17529de7-059e-4b66-942b-e53f174822db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Flow 'volume_create_manager' (9b1cfcef-5443-4fb4-bb66-4a005fc75f6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:39:55 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8506238e-2762-4974-95ec-7429efea3396 tempest-VolumesCloneTest-873059825 None] Created volume successfully. Jul 08 14:39:56 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49" returned: 0 in 0.888s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c16290b-67ad-449c-819a-3c57ec474c07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:39:56 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b152b47-2ff3-44c2-a7e9-1482c4ac4fe9]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:56 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07 Jul 08 14:39:56 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:56 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50fcd936-78f6-487f-a844-c5d49083bf63 tempest-VolumesTestJSON-263628317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e99e0bb3-ec92-49c6-aac5-e20a6c312b22" returned: 0 in 0.784s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50fcd936-78f6-487f-a844-c5d49083bf63 tempest-VolumesTestJSON-263628317 None] Lock "cinder-quobyte-e99e0bb3-ec92-49c6-aac5-e20a6c312b22" released by "delete_volume" :: held 1.887s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:39:56 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-50fcd936-78f6-487f-a844-c5d49083bf63 tempest-VolumesTestJSON-263628317 None] Created reservations ['a7e0af71-12e8-4862-8b52-81dd57c71645', 'b8a1702b-ac1d-4e0f-9054-22d7574ab387', '9d033e3f-5038-4c5f-b823-80c512b9b0af', '8fff9119-5840-4f4f-b07f-c241f6f26f35'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:39:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-50fcd936-78f6-487f-a844-c5d49083bf63 tempest-VolumesTestJSON-263628317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-50fcd936-78f6-487f-a844-c5d49083bf63 tempest-VolumesTestJSON-263628317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-50fcd936-78f6-487f-a844-c5d49083bf63 tempest-VolumesTestJSON-263628317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:39:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-50fcd936-78f6-487f-a844-c5d49083bf63 tempest-VolumesTestJSON-263628317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:39:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-50fcd936-78f6-487f-a844-c5d49083bf63 tempest-VolumesTestJSON-263628317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50fcd936-78f6-487f-a844-c5d49083bf63 tempest-VolumesTestJSON-263628317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:56 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:39:56 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9e57795c-4537-4e67-8bf4-04623c38f3ad tempest-VolumesTestJSON-263628317 None] Acquiring lock "cinder-53c7a91d-1413-47d1-9ac9-c48b4d109515-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:39:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9e57795c-4537-4e67-8bf4-04623c38f3ad tempest-VolumesTestJSON-263628317 None] Lock "cinder-53c7a91d-1413-47d1-9ac9-c48b4d109515-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:39:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9e57795c-4537-4e67-8bf4-04623c38f3ad tempest-VolumesTestJSON-263628317 None] Acquiring lock "cinder-quobyte-53c7a91d-1413-47d1-9ac9-c48b4d109515" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:39:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9e57795c-4537-4e67-8bf4-04623c38f3ad tempest-VolumesTestJSON-263628317 None] Lock "cinder-quobyte-53c7a91d-1413-47d1-9ac9-c48b4d109515" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:39:56 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1608203a-3c0a-4090-95b2-1d49b9b7b63d]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9e57795c-4537-4e67-8bf4-04623c38f3ad tempest-VolumesTestJSON-263628317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-53c7a91d-1413-47d1-9ac9-c48b4d109515 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:56 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-53c7a91d-1413-47d1-9ac9-c48b4d109515 Jul 08 14:39:56 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:57 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07" returned: 0 in 0.870s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9805b06f-8742-43ba-8c95-8a32518d3b4f]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:57 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4 Jul 08 14:39:57 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:57 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50fcd936-78f6-487f-a844-c5d49083bf63 tempest-VolumesTestJSON-263628317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.852s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-50fcd936-78f6-487f-a844-c5d49083bf63 tempest-VolumesTestJSON-263628317 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:39:57 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-50fcd936-78f6-487f-a844-c5d49083bf63 tempest-VolumesTestJSON-263628317 None] Deleted volume successfully. Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50fcd936-78f6-487f-a844-c5d49083bf63 tempest-VolumesTestJSON-263628317 None] Lock "cinder-e99e0bb3-ec92-49c6-aac5-e20a6c312b22-delete_volume" released by "delete_volume" :: held 3.013s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:39:57 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9e57795c-4537-4e67-8bf4-04623c38f3ad tempest-VolumesTestJSON-263628317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-53c7a91d-1413-47d1-9ac9-c48b4d109515" returned: 0 in 0.947s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9e57795c-4537-4e67-8bf4-04623c38f3ad tempest-VolumesTestJSON-263628317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-53c7a91d-1413-47d1-9ac9-c48b4d109515 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:39:57 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-53c7a91d-1413-47d1-9ac9-c48b4d109515 Jul 08 14:39:57 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Flow 'volume_create_manager' (7990c8b4-bc1e-4312-a434-afe88d81bb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d235d475-eabc-49fc-b54a-83e0e2df832b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d235d475-eabc-49fc-b54a-83e0e2df832b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-90060256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f4625e-2b14-49ac-bf10-20a75f353a4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef16addb7cff48f98fada7ae262f1e81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:39:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=a1668ad5-92bf-4fc3-a163-e729d79d9dcb,status='creating',terminated_at=None,updated_at=2026-07-08T12:39:58Z,use_quota=True,user_id='3aaada860a99499e93543db9a500c99e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3972bedd-5e6b-44b8-8df7-ce4a43bc2a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3972bedd-5e6b-44b8-8df7-ce4a43bc2a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80cbca8d-e215-44ec-999a-9074134ee9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80cbca8d-e215-44ec-999a-9074134ee9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b2f4625e-2b14-49ac-bf10-20a75f353a4c', 'volume_name': 'volume-b2f4625e-2b14-49ac-bf10-20a75f353a4c', 'volume_size': 2, 'source_volid': 'a1668ad5-92bf-4fc3-a163-e729d79d9dcb', 'source_volstatus': 'available'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06356fed-f0f0-4cb1-80cf-0e3c2f094212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06356fed-f0f0-4cb1-80cf-0e3c2f094212) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f531aa74-4e00-46a9-8aa0-05f7bfe104af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:39:57 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Volume b2f4625e-2b14-49ac-bf10-20a75f353a4c: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b2f4625e-2b14-49ac-bf10-20a75f353a4c', 'volume_size': 2, 'source_volid': 'a1668ad5-92bf-4fc3-a163-e729d79d9dcb', 'source_volstatus': 'available'} Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:57 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Cloning volume a1668ad5-92bf-4fc3-a163-e729d79d9dcb to volume b2f4625e-2b14-49ac-bf10-20a75f353a4c Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Creating offline snapshot 70d8d8cd-0826-48a5-b312-184ec340a24a of volume a1668ad5-92bf-4fc3-a163-e729d79d9dcb {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0895a2-f50c-4869-a7cc-5a1d96c4a35e]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:58 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4" returned: 0 in 0.915s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c16290b-67ad-449c-819a-3c57ec474c07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:39:58 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b96658-b14f-4458-b797-951804ea67f3]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:58 devstack sudo[98666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb Jul 08 14:39:58 devstack sudo[98666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:58 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49 Jul 08 14:39:58 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:58 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9e57795c-4537-4e67-8bf4-04623c38f3ad tempest-VolumesTestJSON-263628317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-53c7a91d-1413-47d1-9ac9-c48b4d109515" returned: 0 in 0.801s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9e57795c-4537-4e67-8bf4-04623c38f3ad tempest-VolumesTestJSON-263628317 None] Lock "cinder-quobyte-53c7a91d-1413-47d1-9ac9-c48b4d109515" released by "delete_volume" :: held 1.794s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:39:58 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-9e57795c-4537-4e67-8bf4-04623c38f3ad tempest-VolumesTestJSON-263628317 None] Created reservations ['ab9475f6-27ce-469e-abee-532bd464c37a', 'c072a79f-2be0-4407-b01d-0a964a68bbc3', '94c90f23-0d18-4f5d-9384-886534659221', 'e70d1eec-5b9b-4c5a-9e31-16527d1d2470'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:39:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9e57795c-4537-4e67-8bf4-04623c38f3ad tempest-VolumesTestJSON-263628317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9e57795c-4537-4e67-8bf4-04623c38f3ad tempest-VolumesTestJSON-263628317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9e57795c-4537-4e67-8bf4-04623c38f3ad tempest-VolumesTestJSON-263628317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:39:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9e57795c-4537-4e67-8bf4-04623c38f3ad tempest-VolumesTestJSON-263628317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:39:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9e57795c-4537-4e67-8bf4-04623c38f3ad tempest-VolumesTestJSON-263628317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9e57795c-4537-4e67-8bf4-04623c38f3ad tempest-VolumesTestJSON-263628317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:58 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:39:58 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:58 devstack sudo[98666]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb" returned: 0 in 0.889s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.70d8d8cd-0826-48a5-b312-184ec340a24a 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:58 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.70d8d8cd-0826-48a5-b312-184ec340a24a 1G Jul 08 14:39:58 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:59 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49" returned: 0 in 0.994s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c16290b-67ad-449c-819a-3c57ec474c07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:39:59 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5886f8ff-5910-452e-aaf6-15ba19b4caa7]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:39:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:59 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07 Jul 08 14:39:59 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:39:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:39:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:39:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:39:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:39:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:39:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:39:59 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:39:59 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:39:59 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9e57795c-4537-4e67-8bf4-04623c38f3ad tempest-VolumesTestJSON-263628317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.923s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:59 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-9e57795c-4537-4e67-8bf4-04623c38f3ad tempest-VolumesTestJSON-263628317 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:39:59 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9e57795c-4537-4e67-8bf4-04623c38f3ad tempest-VolumesTestJSON-263628317 None] Deleted volume successfully. Jul 08 14:39:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9e57795c-4537-4e67-8bf4-04623c38f3ad tempest-VolumesTestJSON-263628317 None] Lock "cinder-53c7a91d-1413-47d1-9ac9-c48b4d109515-delete_volume" released by "delete_volume" :: held 3.011s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:39:59 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Jul 08 14:39:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.70d8d8cd-0826-48a5-b312-184ec340a24a 1G" returned: 0 in 1.152s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:39:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.70d8d8cd-0826-48a5-b312-184ec340a24a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:00 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.70d8d8cd-0826-48a5-b312-184ec340a24a Jul 08 14:40:00 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:00 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07" returned: 0 in 1.035s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:00 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49 Jul 08 14:40:00 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:00 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.902s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:40:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:40:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:40:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:40:00 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.70d8d8cd-0826-48a5-b312-184ec340a24a" returned: 0 in 0.846s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:00 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.70d8d8cd-0826-48a5-b312-184ec340a24a is being set with open permissions: ugo+rw Jul 08 14:40:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.70d8d8cd-0826-48a5-b312-184ec340a24a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:00 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.70d8d8cd-0826-48a5-b312-184ec340a24a Jul 08 14:40:00 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:01 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49" returned: 0 in 0.891s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:01 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49 Jul 08 14:40:01 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:01 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.70d8d8cd-0826-48a5-b312-184ec340a24a" returned: 0 in 0.719s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:01 devstack sudo[98712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.info Jul 08 14:40:01 devstack sudo[98712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:01 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.93cd3768-bac9-40a2-bd93-fb8f466efc49" returned: 0 in 0.730s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c16290b-67ad-449c-819a-3c57ec474c07 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4 -F qcow2 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:01 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c16290b-67ad-449c-819a-3c57ec474c07 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4 -F qcow2 Jul 08 14:40:01 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:02 devstack sudo[98712]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.info" returned: 0 in 0.777s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:02 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.info is being set with open permissions: ugo+rw Jul 08 14:40:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:02 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.info Jul 08 14:40:02 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:02 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c16290b-67ad-449c-819a-3c57ec474c07 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4 -F qcow2" returned: 0 in 0.846s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-quobyte-93cd3768-bac9-40a2-bd93-fb8f466efc49" released by "_delete_snapshot" :: held 7.427s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-quobyte-9c16290b-67ad-449c-819a-3c57ec474c07" released by "delete_snapshot" :: held 7.452s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:02 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Created reservations ['8553010b-8432-4de7-b0bc-9976a3976d75', '9f9926aa-3b90-4d9f-a35e-1b45b274bcdb', '29dafca0-0297-4502-a50a-caf73bcca2ae', 'b32bdea0-8bf2-43b7-97d4-19a65b6affac'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:40:02 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Delete snapshot completed successfully. Jul 08 14:40:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-93cd3768-bac9-40a2-bd93-fb8f466efc49-delete_snapshot" released by "delete_snapshot" :: held 7.671s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "cinder-a4b62144-56dd-4943-8f78-2fcc24e1ecb4-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-a4b62144-56dd-4943-8f78-2fcc24e1ecb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "cinder-quobyte-9c16290b-67ad-449c-819a-3c57ec474c07" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-quobyte-9c16290b-67ad-449c-819a-3c57ec474c07" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "cinder-quobyte-a4b62144-56dd-4943-8f78-2fcc24e1ecb4" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-quobyte-a4b62144-56dd-4943-8f78-2fcc24e1ecb4" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Deleting offline snapshot a4b62144-56dd-4943-8f78-2fcc24e1ecb4 of volume 9c16290b-67ad-449c-819a-3c57ec474c07 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:40:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] snapshot_file for this snap is: volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:40:03 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f062f09e-885b-493a-b4ee-65b7e8bace22]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:03 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:03 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4 Jul 08 14:40:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.info" returned: 0 in 0.753s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:03 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Acquiring lock "cinder-quobyte-b2f4625e-2b14-49ac-bf10-20a75f353a4c" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Lock "cinder-quobyte-b2f4625e-2b14-49ac-bf10-20a75f353a4c" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] snapshot: 70d8d8cd-0826-48a5-b312-184ec340a24a, volume: b2f4625e-2b14-49ac-bf10-20a75f353a4c, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:40:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:03 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ada7e3-99b3-419b-8521-be66f0a178f9]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.70d8d8cd-0826-48a5-b312-184ec340a24a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:03 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.70d8d8cd-0826-48a5-b312-184ec340a24a Jul 08 14:40:03 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:03 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4" returned: 0 in 0.925s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c16290b-67ad-449c-819a-3c57ec474c07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:40:03 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3e5ddb-854d-41cf-9144-aa5156e8a819]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:04 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07 Jul 08 14:40:04 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:04 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.70d8d8cd-0826-48a5-b312-184ec340a24a" returned: 0 in 0.957s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:40:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:40:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:40:04 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[188be48c-3c1e-4bd4-b449-5bba738fcec2]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:04 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb Jul 08 14:40:04 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:04 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07" returned: 0 in 0.855s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:04 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4 Jul 08 14:40:04 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:05 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb" returned: 0 in 0.959s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:05 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Path /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b2f4625e-2b14-49ac-bf10-20a75f353a4c not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:40:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b2f4625e-2b14-49ac-bf10-20a75f353a4c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:05 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b2f4625e-2b14-49ac-bf10-20a75f353a4c Jul 08 14:40:05 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:05 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4" returned: 0 in 0.933s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:05 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4 Jul 08 14:40:05 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:06 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07.a4b62144-56dd-4943-8f78-2fcc24e1ecb4" returned: 0 in 1.242s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-quobyte-a4b62144-56dd-4943-8f78-2fcc24e1ecb4" released by "_delete_snapshot" :: held 4.180s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-quobyte-9c16290b-67ad-449c-819a-3c57ec474c07" released by "delete_snapshot" :: held 4.228s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:07 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Created reservations ['d887a595-e1e1-433f-851a-6937aeb9e30f', '8da6b459-809c-42d4-a1a1-1c2a524ce651', 'b1c66e53-f4ea-4a32-8fcb-68e1522dd13b', '3e7a08b6-f35e-4474-8d48-21d22ba48b24'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:40:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Delete snapshot completed successfully. Jul 08 14:40:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-a4b62144-56dd-4943-8f78-2fcc24e1ecb4-delete_snapshot" released by "delete_snapshot" :: held 4.729s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Snapshots deleted, issuing volume delete {{(pid=87240) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 14:40:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "cinder-quobyte-9c16290b-67ad-449c-819a-3c57ec474c07" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-quobyte-9c16290b-67ad-449c-819a-3c57ec474c07" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:07 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a52dd7e-466b-4d0d-9a97-26b648e9e12d]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:08 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07 Jul 08 14:40:08 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:10 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07" returned: 0 in 2.271s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:10 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07 Jul 08 14:40:10 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:11 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b2f4625e-2b14-49ac-bf10-20a75f353a4c" returned: 0 in 6.106s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:11 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0378b3d9-2d8e-4510-8287-1c4a330dea8d]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:11 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb Jul 08 14:40:11 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:11 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9c16290b-67ad-449c-819a-3c57ec474c07" returned: 0 in 1.392s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-quobyte-9c16290b-67ad-449c-819a-3c57ec474c07" released by "delete_volume" :: held 3.881s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:11 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Created reservations ['e4e446da-9266-434f-8cc4-95db6176b37a', '77b60b60-d1d9-4ae0-864f-e42ceb01d184', '22abd452-7469-4196-982b-2efedf096902', '25bd009d-89b9-4d40-a8b6-db3e12bf441d'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:40:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:11 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:40:11 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:12 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb" returned: 0 in 1.196s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:12 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Image conversion details: src /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb, size 1024.00 MB, duration 6.11 sec, destination /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b2f4625e-2b14-49ac-bf10-20a75f353a4c {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:40:12 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Converted 1024.00 MB image at 167.61 MB/s Jul 08 14:40:12 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b2f4625e-2b14-49ac-bf10-20a75f353a4c is being set with open permissions: ugo+rw Jul 08 14:40:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b2f4625e-2b14-49ac-bf10-20a75f353a4c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:12 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b2f4625e-2b14-49ac-bf10-20a75f353a4c Jul 08 14:40:12 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:12 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.881s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:12 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:40:12 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Deleted volume successfully. Jul 08 14:40:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb0cf73a-9be4-4054-bb4b-e248ce95686a tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-9c16290b-67ad-449c-819a-3c57ec474c07-delete_volume" released by "delete_volume" :: held 17.560s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:12 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:40:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Flow 'volume_create_manager' (415e1173-fd62-4768-8b54-3fe76b0701ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:40:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99f8bc12-fd99-4641-b02f-ace299603430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99f8bc12-fd99-4641-b02f-ace299603430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1024969749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffc4681e-55f4-4900-aa7b-389f6722bd1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e26674c0b64348bd80fb1d85f96b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:40:13Z,use_quota=True,user_id='59a69ee7b0354bd7abdab19d6b693c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec794d98-d864-40ca-a4c9-d2716ff7072e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec794d98-d864-40ca-a4c9-d2716ff7072e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be3b165-bffa-42bf-b48d-fcf8dda028ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be3b165-bffa-42bf-b48d-fcf8dda028ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffc4681e-55f4-4900-aa7b-389f6722bd1b', 'volume_name': 'volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958ddab8-3690-4449-9185-33a3cdde9ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (958ddab8-3690-4449-9185-33a3cdde9ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c85cb9-c657-4d97-86db-2ab2dd92af55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:12 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Volume ffc4681e-55f4-4900-aa7b-389f6722bd1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b', 'volume_size': 1} Jul 08 14:40:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:13 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-56202250-79a1-48ae-9dad-d0993f1ca8c6 tempest-GroupsTest-891437174 None] Group tempest-Group1-2073644893: creating Jul 08 14:40:13 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-56202250-79a1-48ae-9dad-d0993f1ca8c6 tempest-GroupsTest-891437174 None] Group tempest-Group1-2073644893: created successfully Jul 08 14:40:13 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-56202250-79a1-48ae-9dad-d0993f1ca8c6 tempest-GroupsTest-891437174 None] Create group completed successfully. Jul 08 14:40:13 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b2f4625e-2b14-49ac-bf10-20a75f353a4c" returned: 0 in 0.796s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Lock "cinder-quobyte-b2f4625e-2b14-49ac-bf10-20a75f353a4c" released by "_copy_volume_from_snapshot" :: held 10.124s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Acquiring lock "cinder-quobyte-70d8d8cd-0826-48a5-b312-184ec340a24a" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Lock "cinder-quobyte-70d8d8cd-0826-48a5-b312-184ec340a24a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Deleting offline snapshot 70d8d8cd-0826-48a5-b312-184ec340a24a of volume a1668ad5-92bf-4fc3-a163-e729d79d9dcb {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:40:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] snapshot_file for this snap is: volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.70d8d8cd-0826-48a5-b312-184ec340a24a {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:40:13 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac0a020-d495-4744-9687-4b1b459786ce]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.70d8d8cd-0826-48a5-b312-184ec340a24a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:13 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.70d8d8cd-0826-48a5-b312-184ec340a24a Jul 08 14:40:13 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:14 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.70d8d8cd-0826-48a5-b312-184ec340a24a" returned: 0 in 0.874s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:40:14 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a86803-e7c9-4a74-9232-c5709e1569cd]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:14 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb Jul 08 14:40:14 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:14 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b7235a50-e483-4575-8458-1605dbd6025a tempest-GroupsTest-891437174 None] Group tempest-Group2-1906570225: creating Jul 08 14:40:14 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b7235a50-e483-4575-8458-1605dbd6025a tempest-GroupsTest-891437174 None] Group tempest-Group2-1906570225: created successfully Jul 08 14:40:14 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b7235a50-e483-4575-8458-1605dbd6025a tempest-GroupsTest-891437174 None] Create group completed successfully. Jul 08 14:40:15 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb" returned: 0 in 0.846s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.70d8d8cd-0826-48a5-b312-184ec340a24a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:15 devstack sudo[98803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.70d8d8cd-0826-48a5-b312-184ec340a24a Jul 08 14:40:15 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:16 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.70d8d8cd-0826-48a5-b312-184ec340a24a" returned: 0 in 0.906s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.70d8d8cd-0826-48a5-b312-184ec340a24a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:16 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.70d8d8cd-0826-48a5-b312-184ec340a24a Jul 08 14:40:16 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Flow 'volume_create_manager' (aef3020a-f084-4d8c-8c39-46b59b545c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32db6073-a86e-42e2-95fb-497a8044bc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32db6073-a86e-42e2-95fb-497a8044bc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1266402747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa94981c-a9d6-49a8-bd79-0e420bbda0cf,host='devstack@QuobyteHD#QuobyteHD',id=8490e108-3c40-470e-9557-603c82dbc94d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f97deb93a614182beb5e62ad52db1b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:40:16Z,use_quota=True,user_id='7d4476c4a62b44a389db6898b77800de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ebc43cb-8ad9-41c1-b472-bdec61c73be1),volume_type_id=7ebc43cb-8ad9-41c1-b472-bdec61c73be1)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e2b226-632c-45ea-b105-396f3062be13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86e2b226-632c-45ea-b105-396f3062be13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a609dd-c2a2-463a-868c-27f279ff4ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a609dd-c2a2-463a-868c-27f279ff4ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8490e108-3c40-470e-9557-603c82dbc94d', 'volume_name': 'volume-8490e108-3c40-470e-9557-603c82dbc94d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624f7bc1-ebc4-442c-8526-a3bf941f6c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (624f7bc1-ebc4-442c-8526-a3bf941f6c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85665bed-87bd-4a55-a9da-dc4bd19faa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:16 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Volume 8490e108-3c40-470e-9557-603c82dbc94d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8490e108-3c40-470e-9557-603c82dbc94d', 'volume_size': 1} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:16 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb.70d8d8cd-0826-48a5-b312-184ec340a24a" returned: 0 in 0.747s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Lock "cinder-quobyte-70d8d8cd-0826-48a5-b312-184ec340a24a" released by "_delete_snapshot" :: held 3.497s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.971s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.942s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:40:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1024969749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffc4681e-55f4-4900-aa7b-389f6722bd1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e26674c0b64348bd80fb1d85f96b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:40:13Z,use_quota=True,user_id='59a69ee7b0354bd7abdab19d6b693c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Creating volume ffc4681e-55f4-4900-aa7b-389f6722bd1b {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:40:16 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f531aa74-4e00-46a9-8aa0-05f7bfe104af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2f4625e-2b14-49ac-bf10-20a75f353a4c', 'volume_size': 2, 'source_volid': 'a1668ad5-92bf-4fc3-a163-e729d79d9dcb', 'source_volstatus': 'available'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:16 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b 1073741824 Jul 08 14:40:16 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a7fde79-c51b-4a76-a530-3645e1464d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:16 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Volume volume-b2f4625e-2b14-49ac-bf10-20a75f353a4c (b2f4625e-2b14-49ac-bf10-20a75f353a4c): created successfully Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a7fde79-c51b-4a76-a530-3645e1464d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Flow 'volume_create_manager' (7990c8b4-bc1e-4312-a434-afe88d81bb2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:40:16 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6d25d664-7216-46cc-bd60-fbbc8489f077 tempest-VolumesCloneTest-873059825 None] Created volume successfully. Jul 08 14:40:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3889e218-4942-4a77-8ae2-0e8333e5d169 tempest-VolumesCloneTest-873059825 None] Acquiring lock "cinder-b2f4625e-2b14-49ac-bf10-20a75f353a4c-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3889e218-4942-4a77-8ae2-0e8333e5d169 tempest-VolumesCloneTest-873059825 None] Lock "cinder-b2f4625e-2b14-49ac-bf10-20a75f353a4c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:17 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b 1073741824" returned: 0 in 0.943s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3889e218-4942-4a77-8ae2-0e8333e5d169 tempest-VolumesCloneTest-873059825 None] Acquiring lock "cinder-quobyte-b2f4625e-2b14-49ac-bf10-20a75f353a4c" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3889e218-4942-4a77-8ae2-0e8333e5d169 tempest-VolumesCloneTest-873059825 None] Lock "cinder-quobyte-b2f4625e-2b14-49ac-bf10-20a75f353a4c" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:17 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[60175b31-85bb-4a73-873c-cb5d745f4e30]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3889e218-4942-4a77-8ae2-0e8333e5d169 tempest-VolumesCloneTest-873059825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b2f4625e-2b14-49ac-bf10-20a75f353a4c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:17 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b Jul 08 14:40:17 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:17 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b2f4625e-2b14-49ac-bf10-20a75f353a4c Jul 08 14:40:17 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:18 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b" returned: 0 in 0.671s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:40:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.182s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fa94981c-a9d6-49a8-bd79-0e420bbda0cf,created_at=2026-07-08T12:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1266402747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa94981c-a9d6-49a8-bd79-0e420bbda0cf,host='devstack@QuobyteHD#QuobyteHD',id=8490e108-3c40-470e-9557-603c82dbc94d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f97deb93a614182beb5e62ad52db1b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:40:16Z,use_quota=True,user_id='7d4476c4a62b44a389db6898b77800de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7ebc43cb-8ad9-41c1-b472-bdec61c73be1),volume_type_id=7ebc43cb-8ad9-41c1-b472-bdec61c73be1)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:40:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Creating volume 8490e108-3c40-470e-9557-603c82dbc94d {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:40:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:40:18 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:40:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8490e108-3c40-470e-9557-603c82dbc94d 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c85cb9-c657-4d97-86db-2ab2dd92af55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:18 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8490e108-3c40-470e-9557-603c82dbc94d 1073741824 Jul 08 14:40:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f01a261-b760-471b-90a0-2d99029fbbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:18 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:18 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Volume volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b (ffc4681e-55f4-4900-aa7b-389f6722bd1b): created successfully Jul 08 14:40:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f01a261-b760-471b-90a0-2d99029fbbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Flow 'volume_create_manager' (415e1173-fd62-4768-8b54-3fe76b0701ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:40:18 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ef787329-92bf-4367-9703-1d97757832d6 tempest-VolumesDeleteCascade-1443573958 None] Created volume successfully. Jul 08 14:40:18 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3889e218-4942-4a77-8ae2-0e8333e5d169 tempest-VolumesCloneTest-873059825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b2f4625e-2b14-49ac-bf10-20a75f353a4c" returned: 0 in 0.942s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3889e218-4942-4a77-8ae2-0e8333e5d169 tempest-VolumesCloneTest-873059825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b2f4625e-2b14-49ac-bf10-20a75f353a4c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:18 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b2f4625e-2b14-49ac-bf10-20a75f353a4c Jul 08 14:40:18 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3942750c-0e15-4cf7-988d-9f27ae6b119d tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:19 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8490e108-3c40-470e-9557-603c82dbc94d 1073741824" returned: 0 in 0.989s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8490e108-3c40-470e-9557-603c82dbc94d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:19 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8490e108-3c40-470e-9557-603c82dbc94d Jul 08 14:40:19 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:19 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3889e218-4942-4a77-8ae2-0e8333e5d169 tempest-VolumesCloneTest-873059825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b2f4625e-2b14-49ac-bf10-20a75f353a4c" returned: 0 in 0.796s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3889e218-4942-4a77-8ae2-0e8333e5d169 tempest-VolumesCloneTest-873059825 None] Lock "cinder-quobyte-b2f4625e-2b14-49ac-bf10-20a75f353a4c" released by "delete_volume" :: held 1.796s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:19 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-3889e218-4942-4a77-8ae2-0e8333e5d169 tempest-VolumesCloneTest-873059825 None] Created reservations ['9cd3190f-9d84-4c03-8fe6-93d267cdd711', '0764fffb-1195-4d4e-b5e3-2673d3c601ca', '72621d97-0f8c-41a1-8c74-ca93069d135a', '3fb94f7e-f9bd-4b70-a6d4-c8e965ac855b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:40:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3889e218-4942-4a77-8ae2-0e8333e5d169 tempest-VolumesCloneTest-873059825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3889e218-4942-4a77-8ae2-0e8333e5d169 tempest-VolumesCloneTest-873059825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3889e218-4942-4a77-8ae2-0e8333e5d169 tempest-VolumesCloneTest-873059825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3889e218-4942-4a77-8ae2-0e8333e5d169 tempest-VolumesCloneTest-873059825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3889e218-4942-4a77-8ae2-0e8333e5d169 tempest-VolumesCloneTest-873059825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3889e218-4942-4a77-8ae2-0e8333e5d169 tempest-VolumesCloneTest-873059825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:19 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:40:19 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0e42e221-ce0f-4096-9b42-508a8a8cdf55 tempest-VolumesCloneTest-873059825 None] Acquiring lock "cinder-a1668ad5-92bf-4fc3-a163-e729d79d9dcb-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0e42e221-ce0f-4096-9b42-508a8a8cdf55 tempest-VolumesCloneTest-873059825 None] Lock "cinder-a1668ad5-92bf-4fc3-a163-e729d79d9dcb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0e42e221-ce0f-4096-9b42-508a8a8cdf55 tempest-VolumesCloneTest-873059825 None] Acquiring lock "cinder-quobyte-a1668ad5-92bf-4fc3-a163-e729d79d9dcb" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0e42e221-ce0f-4096-9b42-508a8a8cdf55 tempest-VolumesCloneTest-873059825 None] Lock "cinder-quobyte-a1668ad5-92bf-4fc3-a163-e729d79d9dcb" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:20 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d649243-3a7e-4736-8916-3806a31b290d]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0e42e221-ce0f-4096-9b42-508a8a8cdf55 tempest-VolumesCloneTest-873059825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:20 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8490e108-3c40-470e-9557-603c82dbc94d" returned: 0 in 0.790s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:40:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3942750c-0e15-4cf7-988d-9f27ae6b119d tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.966s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:20 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb Jul 08 14:40:20 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85665bed-87bd-4a55-a9da-dc4bd19faa7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8490e108-3c40-470e-9557-603c82dbc94d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cc6305-7233-4da2-8216-4945e153dd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-3942750c-0e15-4cf7-988d-9f27ae6b119d tempest-VolumesDeleteCascade-1443573958 None] Creating offline snapshot 2e8362dd-b67d-4ae1-bcd1-64a55f1dece0 of volume ffc4681e-55f4-4900-aa7b-389f6722bd1b {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:40:20 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Volume volume-8490e108-3c40-470e-9557-603c82dbc94d (8490e108-3c40-470e-9557-603c82dbc94d): created successfully Jul 08 14:40:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1cc6305-7233-4da2-8216-4945e153dd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Flow 'volume_create_manager' (aef3020a-f084-4d8c-8c39-46b59b545c3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:40:20 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db3856c-a920-40fd-967a-a5deec46610f]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3942750c-0e15-4cf7-988d-9f27ae6b119d tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:20 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b16a9f33-eb27-490b-a562-2fee061882db tempest-GroupsTest-891437174 None] Created volume successfully. Jul 08 14:40:20 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b Jul 08 14:40:20 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:20 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3889e218-4942-4a77-8ae2-0e8333e5d169 tempest-VolumesCloneTest-873059825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.836s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:20 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-3889e218-4942-4a77-8ae2-0e8333e5d169 tempest-VolumesCloneTest-873059825 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:40:20 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3889e218-4942-4a77-8ae2-0e8333e5d169 tempest-VolumesCloneTest-873059825 None] Deleted volume successfully. Jul 08 14:40:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3889e218-4942-4a77-8ae2-0e8333e5d169 tempest-VolumesCloneTest-873059825 None] Lock "cinder-b2f4625e-2b14-49ac-bf10-20a75f353a4c-delete_volume" released by "delete_volume" :: held 2.905s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:21 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0e42e221-ce0f-4096-9b42-508a8a8cdf55 tempest-VolumesCloneTest-873059825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb" returned: 0 in 0.948s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0e42e221-ce0f-4096-9b42-508a8a8cdf55 tempest-VolumesCloneTest-873059825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:21 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb Jul 08 14:40:21 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:21 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3942750c-0e15-4cf7-988d-9f27ae6b119d tempest-VolumesDeleteCascade-1443573958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b" returned: 0 in 0.893s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3942750c-0e15-4cf7-988d-9f27ae6b119d tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.2e8362dd-b67d-4ae1-bcd1-64a55f1dece0 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:21 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.2e8362dd-b67d-4ae1-bcd1-64a55f1dece0 1G Jul 08 14:40:21 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0645daa3-6e28-43df-b35b-d1fc9f642427 tempest-GroupsTest-891437174 None] Acquiring lock "cinder-quobyte-8490e108-3c40-470e-9557-603c82dbc94d" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0645daa3-6e28-43df-b35b-d1fc9f642427 tempest-GroupsTest-891437174 None] Lock "cinder-quobyte-8490e108-3c40-470e-9557-603c82dbc94d" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:21 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09d032c-8adf-47fc-90ae-ece34bc1eb67]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0645daa3-6e28-43df-b35b-d1fc9f642427 tempest-GroupsTest-891437174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8490e108-3c40-470e-9557-603c82dbc94d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:21 devstack sudo[98855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8490e108-3c40-470e-9557-603c82dbc94d Jul 08 14:40:21 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:21 devstack sudo[98855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0e42e221-ce0f-4096-9b42-508a8a8cdf55 tempest-VolumesCloneTest-873059825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a1668ad5-92bf-4fc3-a163-e729d79d9dcb" returned: 0 in 0.733s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0e42e221-ce0f-4096-9b42-508a8a8cdf55 tempest-VolumesCloneTest-873059825 None] Lock "cinder-quobyte-a1668ad5-92bf-4fc3-a163-e729d79d9dcb" released by "delete_volume" :: held 1.748s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:22 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-0e42e221-ce0f-4096-9b42-508a8a8cdf55 tempest-VolumesCloneTest-873059825 None] Created reservations ['9988de25-38fe-4a07-998e-0b2a8eb7c642', 'b1a4c22f-001b-4d8b-b4d7-bfae4777dc0a', '59e5ac5c-15a4-4fca-80a2-6d4234def333', '18050e2a-bff5-4aea-b30f-8933208fcd8c'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:40:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0e42e221-ce0f-4096-9b42-508a8a8cdf55 tempest-VolumesCloneTest-873059825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0e42e221-ce0f-4096-9b42-508a8a8cdf55 tempest-VolumesCloneTest-873059825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0e42e221-ce0f-4096-9b42-508a8a8cdf55 tempest-VolumesCloneTest-873059825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0e42e221-ce0f-4096-9b42-508a8a8cdf55 tempest-VolumesCloneTest-873059825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0e42e221-ce0f-4096-9b42-508a8a8cdf55 tempest-VolumesCloneTest-873059825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0e42e221-ce0f-4096-9b42-508a8a8cdf55 tempest-VolumesCloneTest-873059825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:22 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:40:22 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:22 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3942750c-0e15-4cf7-988d-9f27ae6b119d tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.2e8362dd-b67d-4ae1-bcd1-64a55f1dece0 1G" returned: 0 in 0.985s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3942750c-0e15-4cf7-988d-9f27ae6b119d tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.2e8362dd-b67d-4ae1-bcd1-64a55f1dece0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:22 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.2e8362dd-b67d-4ae1-bcd1-64a55f1dece0 Jul 08 14:40:22 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:22 devstack sudo[98855]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0645daa3-6e28-43df-b35b-d1fc9f642427 tempest-GroupsTest-891437174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8490e108-3c40-470e-9557-603c82dbc94d" returned: 0 in 0.929s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0645daa3-6e28-43df-b35b-d1fc9f642427 tempest-GroupsTest-891437174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8490e108-3c40-470e-9557-603c82dbc94d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:22 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8490e108-3c40-470e-9557-603c82dbc94d Jul 08 14:40:22 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:22 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0e42e221-ce0f-4096-9b42-508a8a8cdf55 tempest-VolumesCloneTest-873059825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.831s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:22 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-0e42e221-ce0f-4096-9b42-508a8a8cdf55 tempest-VolumesCloneTest-873059825 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:40:22 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0e42e221-ce0f-4096-9b42-508a8a8cdf55 tempest-VolumesCloneTest-873059825 None] Deleted volume successfully. Jul 08 14:40:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0e42e221-ce0f-4096-9b42-508a8a8cdf55 tempest-VolumesCloneTest-873059825 None] Lock "cinder-a1668ad5-92bf-4fc3-a163-e729d79d9dcb-delete_volume" released by "delete_volume" :: held 2.858s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:23 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3942750c-0e15-4cf7-988d-9f27ae6b119d tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.2e8362dd-b67d-4ae1-bcd1-64a55f1dece0" returned: 0 in 0.919s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:23 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-3942750c-0e15-4cf7-988d-9f27ae6b119d tempest-VolumesDeleteCascade-1443573958 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.2e8362dd-b67d-4ae1-bcd1-64a55f1dece0 is being set with open permissions: ugo+rw Jul 08 14:40:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3942750c-0e15-4cf7-988d-9f27ae6b119d tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.2e8362dd-b67d-4ae1-bcd1-64a55f1dece0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:23 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.2e8362dd-b67d-4ae1-bcd1-64a55f1dece0 Jul 08 14:40:23 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:23 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0645daa3-6e28-43df-b35b-d1fc9f642427 tempest-GroupsTest-891437174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8490e108-3c40-470e-9557-603c82dbc94d" returned: 0 in 0.827s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0645daa3-6e28-43df-b35b-d1fc9f642427 tempest-GroupsTest-891437174 None] Lock "cinder-quobyte-8490e108-3c40-470e-9557-603c82dbc94d" released by "delete_volume" :: held 1.808s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:23 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-0645daa3-6e28-43df-b35b-d1fc9f642427 tempest-GroupsTest-891437174 None] Created reservations ['c8128dac-0221-4225-a29c-cb493f4bd582'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:40:23 devstack cinder-volume[87240]: WARNING cinder.quota [None req-0645daa3-6e28-43df-b35b-d1fc9f642427 tempest-GroupsTest-891437174 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1679698533 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1679698533, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:40:23 devstack cinder-volume[87240]: WARNING cinder.quota [None req-0645daa3-6e28-43df-b35b-d1fc9f642427 tempest-GroupsTest-891437174 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1679698533 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1679698533, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:40:23 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-0645daa3-6e28-43df-b35b-d1fc9f642427 tempest-GroupsTest-891437174 None] Created reservations ['dd993d2b-8ade-4f6d-91f7-2dc92dbf8f35', '6f72b58e-a8a7-4a60-bbfb-d1021fa4e25e', '0fdaf971-23bf-4217-8544-dbc1b894a27c', '672005ce-9f47-4b44-bb3d-0cb14937dbda'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:40:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0645daa3-6e28-43df-b35b-d1fc9f642427 tempest-GroupsTest-891437174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0645daa3-6e28-43df-b35b-d1fc9f642427 tempest-GroupsTest-891437174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0645daa3-6e28-43df-b35b-d1fc9f642427 tempest-GroupsTest-891437174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0645daa3-6e28-43df-b35b-d1fc9f642427 tempest-GroupsTest-891437174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0645daa3-6e28-43df-b35b-d1fc9f642427 tempest-GroupsTest-891437174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0645daa3-6e28-43df-b35b-d1fc9f642427 tempest-GroupsTest-891437174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:23 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:40:23 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:24 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3942750c-0e15-4cf7-988d-9f27ae6b119d tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.2e8362dd-b67d-4ae1-bcd1-64a55f1dece0" returned: 0 in 0.747s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3942750c-0e15-4cf7-988d-9f27ae6b119d tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:24 devstack sudo[98882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.info Jul 08 14:40:24 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:24 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-f4ce3d0e-d28f-4fb8-b821-36b1c3658019 tempest-GroupsTest-891437174 None] Created reservations ['41f2f304-5e7e-4a4f-9ad1-ee3f8c6a65f1'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:40:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f4ce3d0e-d28f-4fb8-b821-36b1c3658019 tempest-GroupsTest-891437174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f4ce3d0e-d28f-4fb8-b821-36b1c3658019 tempest-GroupsTest-891437174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f4ce3d0e-d28f-4fb8-b821-36b1c3658019 tempest-GroupsTest-891437174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f4ce3d0e-d28f-4fb8-b821-36b1c3658019 tempest-GroupsTest-891437174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f4ce3d0e-d28f-4fb8-b821-36b1c3658019 tempest-GroupsTest-891437174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f4ce3d0e-d28f-4fb8-b821-36b1c3658019 tempest-GroupsTest-891437174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:24 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:40:24 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:24 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0645daa3-6e28-43df-b35b-d1fc9f642427 tempest-GroupsTest-891437174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.819s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:24 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-0645daa3-6e28-43df-b35b-d1fc9f642427 tempest-GroupsTest-891437174 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:40:24 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0645daa3-6e28-43df-b35b-d1fc9f642427 tempest-GroupsTest-891437174 None] Delete group completed successfully. Jul 08 14:40:24 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3942750c-0e15-4cf7-988d-9f27ae6b119d tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.info" returned: 0 in 0.850s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:24 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-3942750c-0e15-4cf7-988d-9f27ae6b119d tempest-VolumesDeleteCascade-1443573958 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.info is being set with open permissions: ugo+rw Jul 08 14:40:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3942750c-0e15-4cf7-988d-9f27ae6b119d tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:24 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.info Jul 08 14:40:24 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:25 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f4ce3d0e-d28f-4fb8-b821-36b1c3658019 tempest-GroupsTest-891437174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.839s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:25 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-f4ce3d0e-d28f-4fb8-b821-36b1c3658019 tempest-GroupsTest-891437174 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:40:25 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f4ce3d0e-d28f-4fb8-b821-36b1c3658019 tempest-GroupsTest-891437174 None] Delete group completed successfully. Jul 08 14:40:25 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3942750c-0e15-4cf7-988d-9f27ae6b119d tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.info" returned: 0 in 0.783s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3942750c-0e15-4cf7-988d-9f27ae6b119d tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.337s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:25 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3942750c-0e15-4cf7-988d-9f27ae6b119d tempest-VolumesDeleteCascade-1443573958 None] Create snapshot completed successfully Jul 08 14:40:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-36abd9cb-fb90-46df-ad85-de1dbf66062e tempest-GroupsTest-891437174 None] Group tempest-GroupsTest-Group-1390275356: creating Jul 08 14:40:26 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=84,cinder:UPDATE=108,cinder:INSERT=27,cinder:DELETE=10 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:40:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-36abd9cb-fb90-46df-ad85-de1dbf66062e tempest-GroupsTest-891437174 None] Group tempest-GroupsTest-Group-1390275356: created successfully Jul 08 14:40:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-36abd9cb-fb90-46df-ad85-de1dbf66062e tempest-GroupsTest-891437174 None] Create group completed successfully. Jul 08 14:40:26 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:40:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Flow 'volume_create_manager' (e0a48548-5ec0-47b8-a70c-b5a2e560348d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:40:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880bcab3-2730-47d1-82c4-c3f1835f36c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (880bcab3-2730-47d1-82c4-c3f1835f36c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1966649541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65220a8f-7687-4ff2-b8f2-b8cbad29efd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ba41c38ee45408dacb18a48870092e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:40:27Z,use_quota=True,user_id='2db3f49ad5124bb795e3d2664d1a0c57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b4f0e57-3abe-4ecf-b789-5f117f05f08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b4f0e57-3abe-4ecf-b789-5f117f05f08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c746b9bd-0ca7-4581-8171-4fca285b4d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:26 devstack cinder-volume[87240]: DEBUG cinder.image.glance [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Creating Keystone auth plugin from conf {{(pid=87240) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 14:40:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c746b9bd-0ca7-4581-8171-4fca285b4d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '65220a8f-7687-4ff2-b8f2-b8cbad29efd3', 'volume_name': 'volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3', 'volume_size': 1, 'image_id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f84c09b9fe464edfa51b7a3d44e3b143', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e431277e-680a-42c0-9164-17b254387824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e431277e-680a-42c0-9164-17b254387824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4516899-3788-43b6-ac3d-18e18dfa3e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:27 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Volume 65220a8f-7687-4ff2-b8f2-b8cbad29efd3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3', 'volume_size': 1, 'image_id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f84c09b9fe464edfa51b7a3d44e3b143', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Trying to clone 65220a8f-7687-4ff2-b8f2-b8cbad29efd3 from image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}]). {{(pid=87240) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_f2_p8nfndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 14:40:27 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Image download 20.69 MB at 20.69 MB/s Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab3d55f-2488-4d80-adfb-f32b35e4638d]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_f2_p8nfndevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Flow 'volume_create_manager' (9543ef53-93f8-42af-ab97-93210378e3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (226481a6-f860-4bfd-8994-5270b2e1ccdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (226481a6-f860-4bfd-8994-5270b2e1ccdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1256228793',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55e26674c0b64348bd80fb1d85f96b9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2e8362dd-b67d-4ae1-bcd1-64a55f1dece0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:40:27Z,use_quota=True,user_id='59a69ee7b0354bd7abdab19d6b693c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e63c27-f635-489b-93f4-1ca7847c525d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e63c27-f635-489b-93f4-1ca7847c525d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71fe4f18-70b6-46b5-bd50-b7932dd69298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71fe4f18-70b6-46b5-bd50-b7932dd69298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d', 'volume_name': 'volume-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d', 'volume_size': 1, 'snapshot_id': '2e8362dd-b67d-4ae1-bcd1-64a55f1dece0'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a37a39-da1b-4820-b277-fcfc45f234cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a37a39-da1b-4820-b277-fcfc45f234cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a593d0-dbf8-41b8-acb9-45b11370c60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:27 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_f2_p8nfndevstack@QuobyteHD Jul 08 14:40:27 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Volume ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d', 'volume_size': 1, 'snapshot_id': '2e8362dd-b67d-4ae1-bcd1-64a55f1dece0'} Jul 08 14:40:27 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "cinder-quobyte-2e8362dd-b67d-4ae1-bcd1-64a55f1dece0-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d" by "_create_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-quobyte-2e8362dd-b67d-4ae1-bcd1-64a55f1dece0-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Creating volume ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d from snapshot 2e8362dd-b67d-4ae1-bcd1-64a55f1dece0 {{(pid=87240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "cinder-quobyte-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-quobyte-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] snapshot: 2e8362dd-b67d-4ae1-bcd1-64a55f1dece0, volume: ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe4aa8c0-5ea3-4d32-8321-f64992e3ba29]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.2e8362dd-b67d-4ae1-bcd1-64a55f1dece0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Flow 'volume_create_manager' (b4a93ea9-d87f-4962-a646-71bd8e9f2c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a4a0af-06b7-4846-89da-95cb2667dfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:27 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.2e8362dd-b67d-4ae1-bcd1-64a55f1dece0 Jul 08 14:40:27 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a4a0af-06b7-4846-89da-95cb2667dfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-934472879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e70f8f36-515f-4e98-b6d9-847abfacbceb,host='devstack@QuobyteHD#QuobyteHD',id=5deac2f5-e6af-417d-849c-134128616bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f97deb93a614182beb5e62ad52db1b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:40:28Z,use_quota=True,user_id='7d4476c4a62b44a389db6898b77800de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6bc82a2f-cef7-47bd-bda2-58c2cec34ef9),volume_type_id=6bc82a2f-cef7-47bd-bda2-58c2cec34ef9)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2fb961-651c-4d5f-aa0d-5574cea6c178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2fb961-651c-4d5f-aa0d-5574cea6c178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1a81f4-727f-4b7d-a697-f4a57be0fd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c1a81f4-727f-4b7d-a697-f4a57be0fd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5deac2f5-e6af-417d-849c-134128616bb1', 'volume_name': 'volume-5deac2f5-e6af-417d-849c-134128616bb1', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf912a4-d36a-431d-8be7-c9dc21a8a3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbf912a4-d36a-431d-8be7-c9dc21a8a3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41bba6b-25b7-48fc-b57a-8bf1784883f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:28 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Volume 5deac2f5-e6af-417d-849c-134128616bb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5deac2f5-e6af-417d-849c-134128616bb1', 'volume_size': 1} Jul 08 14:40:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:28 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_f2_p8nfndevstack@QuobyteHD" returned: 0 in 0.898s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:28 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Temporary image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 is fetched for user 2db3f49ad5124bb795e3d2664d1a0c57. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 14:40:28 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29bd4db-dd82-4f07-923a-253943a66f8a]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_f2_p8nfndevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:28 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_f2_p8nfndevstack@QuobyteHD Jul 08 14:40:28 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:28 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.2e8362dd-b67d-4ae1-bcd1-64a55f1dece0" returned: 0 in 0.882s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:40:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:40:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:40:28 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fc675c-98aa-4a1c-b7d0-f3543b528981]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:28 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b Jul 08 14:40:28 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:29 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_f2_p8nfndevstack@QuobyteHD" returned: 0 in 0.816s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:29 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b" returned: 0 in 0.806s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:29 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Path /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:40:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:29 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d Jul 08 14:40:29 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:34 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d" returned: 0 in 5.086s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:34 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b02bfe-8924-4525-a113-46e5db629cf5]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:34 devstack sudo[98927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b Jul 08 14:40:34 devstack sudo[98927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:35 devstack sudo[98927]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b" returned: 0 in 1.122s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:35 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Image conversion details: src /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b, size 1024.00 MB, duration 5.09 sec, destination /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:40:35 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Converted 1024.00 MB image at 201.29 MB/s Jul 08 14:40:35 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d is being set with open permissions: ugo+rw Jul 08 14:40:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:35 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d Jul 08 14:40:35 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:36 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d" returned: 0 in 0.827s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-quobyte-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d" released by "_copy_volume_from_snapshot" :: held 8.836s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-quobyte-2e8362dd-b67d-4ae1-bcd1-64a55f1dece0-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d" released by "_create_volume_from_snapshot" :: held 8.867s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.888s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.599s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e70f8f36-515f-4e98-b6d9-847abfacbceb,created_at=2026-07-08T12:40:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-934472879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e70f8f36-515f-4e98-b6d9-847abfacbceb,host='devstack@QuobyteHD#QuobyteHD',id=5deac2f5-e6af-417d-849c-134128616bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f97deb93a614182beb5e62ad52db1b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:40:28Z,use_quota=True,user_id='7d4476c4a62b44a389db6898b77800de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6bc82a2f-cef7-47bd-bda2-58c2cec34ef9),volume_type_id=6bc82a2f-cef7-47bd-bda2-58c2cec34ef9)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:40:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Creating volume 5deac2f5-e6af-417d-849c-134128616bb1 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:40:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:40:36 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:40:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5deac2f5-e6af-417d-849c-134128616bb1 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:36 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5deac2f5-e6af-417d-849c-134128616bb1 1073741824 Jul 08 14:40:36 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2a593d0-dbf8-41b8-acb9-45b11370c60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d', 'volume_size': 1, 'snapshot_id': '2e8362dd-b67d-4ae1-bcd1-64a55f1dece0'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a78e097-ba66-4b52-a05f-ce0dd1e92a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:36 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Volume volume-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d (ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d): created successfully Jul 08 14:40:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a78e097-ba66-4b52-a05f-ce0dd1e92a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Flow 'volume_create_manager' (9543ef53-93f8-42af-ab97-93210378e3cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:40:36 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ad3862b2-e6bb-4b00-b811-74e3d911f423 tempest-VolumesDeleteCascade-1443573958 None] Created volume successfully. Jul 08 14:40:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "cinder-ffc4681e-55f4-4900-aa7b-389f6722bd1b-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-ffc4681e-55f4-4900-aa7b-389f6722bd1b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Performing cascade delete. {{(pid=87240) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 14:40:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "cinder-2e8362dd-b67d-4ae1-bcd1-64a55f1dece0-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-2e8362dd-b67d-4ae1-bcd1-64a55f1dece0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "cinder-quobyte-ffc4681e-55f4-4900-aa7b-389f6722bd1b" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-quobyte-ffc4681e-55f4-4900-aa7b-389f6722bd1b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "cinder-quobyte-2e8362dd-b67d-4ae1-bcd1-64a55f1dece0" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-quobyte-2e8362dd-b67d-4ae1-bcd1-64a55f1dece0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Deleting offline snapshot 2e8362dd-b67d-4ae1-bcd1-64a55f1dece0 of volume ffc4681e-55f4-4900-aa7b-389f6722bd1b {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:40:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] snapshot_file for this snap is: volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.2e8362dd-b67d-4ae1-bcd1-64a55f1dece0 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:40:37 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4754c3-1bec-4c2c-a9a9-b1c7bab71b2b]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.2e8362dd-b67d-4ae1-bcd1-64a55f1dece0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:37 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5deac2f5-e6af-417d-849c-134128616bb1 1073741824" returned: 0 in 1.048s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5deac2f5-e6af-417d-849c-134128616bb1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:37 devstack sudo[98941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.2e8362dd-b67d-4ae1-bcd1-64a55f1dece0 Jul 08 14:40:37 devstack sudo[98941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:37 devstack sudo[98942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5deac2f5-e6af-417d-849c-134128616bb1 Jul 08 14:40:37 devstack sudo[98942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:38 devstack sudo[98942]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5deac2f5-e6af-417d-849c-134128616bb1" returned: 0 in 0.821s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] <== create_volume: return (1920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:40:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.924s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.231s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1966649541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65220a8f-7687-4ff2-b8f2-b8cbad29efd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ba41c38ee45408dacb18a48870092e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:40:27Z,use_quota=True,user_id='2db3f49ad5124bb795e3d2664d1a0c57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:40:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Creating volume 65220a8f-7687-4ff2-b8f2-b8cbad29efd3 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:40:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:40:38 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:40:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:38 devstack sudo[98941]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:38 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 1073741824 Jul 08 14:40:38 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.2e8362dd-b67d-4ae1-bcd1-64a55f1dece0" returned: 0 in 1.053s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:40:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41bba6b-25b7-48fc-b57a-8bf1784883f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5deac2f5-e6af-417d-849c-134128616bb1', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06e1741-07ec-4cca-b3a8-fa2bce6cad7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:38 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9643f47a-197a-4eb2-9cfe-cc4afecd9807]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:38 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Volume volume-5deac2f5-e6af-417d-849c-134128616bb1 (5deac2f5-e6af-417d-849c-134128616bb1): created successfully Jul 08 14:40:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b06e1741-07ec-4cca-b3a8-fa2bce6cad7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Flow 'volume_create_manager' (b4a93ea9-d87f-4962-a646-71bd8e9f2c65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:40:38 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b259fb98-7879-4add-a02e-507a189d9cac tempest-GroupsTest-891437174 None] Created volume successfully. Jul 08 14:40:38 devstack sudo[98951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b Jul 08 14:40:38 devstack sudo[98951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:39 devstack sudo[98951]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b" returned: 0 in 1.057s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.2e8362dd-b67d-4ae1-bcd1-64a55f1dece0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:39 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 1073741824" returned: 0 in 1.170s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:39 devstack sudo[98959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.2e8362dd-b67d-4ae1-bcd1-64a55f1dece0 Jul 08 14:40:39 devstack sudo[98959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:39 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 Jul 08 14:40:39 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Flow 'volume_create_manager' (cf7c871e-4486-48ab-bde1-a8627784e444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f917943-9a92-4b7e-bde2-4fe448793eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f917943-9a92-4b7e-bde2-4fe448793eb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1521229054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e70f8f36-515f-4e98-b6d9-847abfacbceb,host='devstack@QuobyteHD#QuobyteHD',id=15358c25-ccf7-4e71-9c37-7e7880ba06b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f97deb93a614182beb5e62ad52db1b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:40:40Z,use_quota=True,user_id='7d4476c4a62b44a389db6898b77800de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6bc82a2f-cef7-47bd-bda2-58c2cec34ef9),volume_type_id=6bc82a2f-cef7-47bd-bda2-58c2cec34ef9)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1d6a7a-7dfd-4bbf-b2c7-b465af28f281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1d6a7a-7dfd-4bbf-b2c7-b465af28f281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f73da5be-a795-4768-9b74-f4bd92e5e7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f73da5be-a795-4768-9b74-f4bd92e5e7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15358c25-ccf7-4e71-9c37-7e7880ba06b6', 'volume_name': 'volume-15358c25-ccf7-4e71-9c37-7e7880ba06b6', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ad2123-052b-4fbc-923e-edd541e06d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28ad2123-052b-4fbc-923e-edd541e06d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503ef16e-3b95-45f2-a55f-255dcdb649c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:40 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Volume 15358c25-ccf7-4e71-9c37-7e7880ba06b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15358c25-ccf7-4e71-9c37-7e7880ba06b6', 'volume_size': 1} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:40 devstack sudo[98959]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.2e8362dd-b67d-4ae1-bcd1-64a55f1dece0" returned: 0 in 0.961s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.2e8362dd-b67d-4ae1-bcd1-64a55f1dece0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:40 devstack sudo[98967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.2e8362dd-b67d-4ae1-bcd1-64a55f1dece0 Jul 08 14:40:40 devstack sudo[98967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:40 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3" returned: 0 in 0.914s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] <== create_volume: return (2134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.137s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.520s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e70f8f36-515f-4e98-b6d9-847abfacbceb,created_at=2026-07-08T12:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1521229054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e70f8f36-515f-4e98-b6d9-847abfacbceb,host='devstack@QuobyteHD#QuobyteHD',id=15358c25-ccf7-4e71-9c37-7e7880ba06b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f97deb93a614182beb5e62ad52db1b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:40:40Z,use_quota=True,user_id='7d4476c4a62b44a389db6898b77800de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6bc82a2f-cef7-47bd-bda2-58c2cec34ef9),volume_type_id=6bc82a2f-cef7-47bd-bda2-58c2cec34ef9)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Creating volume 15358c25-ccf7-4e71-9c37-7e7880ba06b6 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:40:40 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-15358c25-ccf7-4e71-9c37-7e7880ba06b6 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:40 devstack sudo[98969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-15358c25-ccf7-4e71-9c37-7e7880ba06b6 1073741824 Jul 08 14:40:40 devstack sudo[98969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Attempting download of 8a72c3c4-bdc8-4198-ab53-8c7f86124915 ((None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}])) to volume 65220a8f-7687-4ff2-b8f2-b8cbad29efd3. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01ac784-6997-4a52-a894-e779d1adc2ef]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_kmh13d41 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:40 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_kmh13d41 Jul 08 14:40:40 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:41 devstack sudo[98967]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b.2e8362dd-b67d-4ae1-bcd1-64a55f1dece0" returned: 0 in 0.693s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-quobyte-2e8362dd-b67d-4ae1-bcd1-64a55f1dece0" released by "_delete_snapshot" :: held 3.882s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-quobyte-ffc4681e-55f4-4900-aa7b-389f6722bd1b" released by "delete_snapshot" :: held 3.905s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:41 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=121,cinder:SELECT=107,cinder:INSERT=28,cinder:DELETE=9 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:40:41 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Created reservations ['95b6d680-7aff-4030-a946-a89d2ccfd40c', '431d475d-04c4-4505-be15-d8093d267105', '3f246b78-c2bb-436f-abe7-bafeb722f619', 'bb970ca2-23f1-46fa-8b7f-c31426c69f5e'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:40:41 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Delete snapshot completed successfully. Jul 08 14:40:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-2e8362dd-b67d-4ae1-bcd1-64a55f1dece0-delete_snapshot" released by "delete_snapshot" :: held 4.120s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Snapshots deleted, issuing volume delete {{(pid=87240) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 14:40:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "cinder-quobyte-ffc4681e-55f4-4900-aa7b-389f6722bd1b" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-quobyte-ffc4681e-55f4-4900-aa7b-389f6722bd1b" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:41 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1207ad-cdb0-4227-99b6-dc11f298a49c]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:41 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_kmh13d41" returned: 0 in 0.852s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_kmh13d41 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:41 devstack sudo[98981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b Jul 08 14:40:41 devstack sudo[98981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:41 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_kmh13d41 Jul 08 14:40:41 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:41 devstack sudo[98969]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-15358c25-ccf7-4e71-9c37-7e7880ba06b6 1073741824" returned: 0 in 1.111s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-15358c25-ccf7-4e71-9c37-7e7880ba06b6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:41 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-15358c25-ccf7-4e71-9c37-7e7880ba06b6 Jul 08 14:40:41 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:42 devstack sudo[98981]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b" returned: 0 in 0.873s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:42 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b Jul 08 14:40:42 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:42 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:42 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-15358c25-ccf7-4e71-9c37-7e7880ba06b6" returned: 0 in 0.700s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:40:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_kmh13d41" returned: 1 in 0.903s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_kmh13d41' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:40:42 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6315533-0a4b-42b6-94c4-71dc36984968]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_f2_p8nfndevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503ef16e-3b95-45f2-a55f-255dcdb649c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15358c25-ccf7-4e71-9c37-7e7880ba06b6', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e66f5d-c0af-4ec6-bc95-57d6d1bc8239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:42 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Volume volume-15358c25-ccf7-4e71-9c37-7e7880ba06b6 (15358c25-ccf7-4e71-9c37-7e7880ba06b6): created successfully Jul 08 14:40:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34e66f5d-c0af-4ec6-bc95-57d6d1bc8239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Flow 'volume_create_manager' (cf7c871e-4486-48ab-bde1-a8627784e444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:40:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-48aa37a5-ebb9-42d5-a94d-f065f70a9e6e tempest-GroupsTest-891437174 None] Created volume successfully. Jul 08 14:40:42 devstack sudo[98995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_f2_p8nfndevstack@QuobyteHD Jul 08 14:40:42 devstack sudo[98995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:43 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ffc4681e-55f4-4900-aa7b-389f6722bd1b" returned: 0 in 0.704s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-quobyte-ffc4681e-55f4-4900-aa7b-389f6722bd1b" released by "delete_volume" :: held 1.648s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:43 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Created reservations ['0c0420b8-b14a-475c-9e4c-df9ac903a6f8', 'bf0da00d-aa3d-46e0-a142-56b32b6a4616', 'fa58493e-426b-4929-be18-6a0680707f2e', 'cfe6772a-c4e2-40a1-9971-f322744b977e'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:40:43 devstack sudo[98995]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_f2_p8nfndevstack@QuobyteHD" returned: 0 in 0.787s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:43 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] 8a72c3c4-bdc8-4198-ab53-8c7f86124915 was qcow2, converting to raw {{(pid=87240) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 14:40:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_f2_p8nfndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:43 devstack sudo[99001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_f2_p8nfndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 Jul 08 14:40:43 devstack sudo[99001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:43 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:40:43 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:43 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f1a8fea8-fb3b-4592-b64b-4b7ff55d24cc tempest-GroupsTest-891437174 None] Update group completed successfully. Jul 08 14:40:44 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.709s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:44 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:40:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Deleted volume successfully. Jul 08 14:40:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fecb3a4d-d3ce-4645-b35e-8addf1071c0e tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-ffc4681e-55f4-4900-aa7b-389f6722bd1b-delete_volume" released by "delete_volume" :: held 6.781s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fd648435-34c2-4b66-9edd-0246444f63e4 tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "cinder-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fd648435-34c2-4b66-9edd-0246444f63e4 tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fd648435-34c2-4b66-9edd-0246444f63e4 tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "cinder-quobyte-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fd648435-34c2-4b66-9edd-0246444f63e4 tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-quobyte-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eda1869-780b-4a1e-863c-c60aaa3ea7e5]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fd648435-34c2-4b66-9edd-0246444f63e4 tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:44 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d Jul 08 14:40:44 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:45 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fd648435-34c2-4b66-9edd-0246444f63e4 tempest-VolumesDeleteCascade-1443573958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d" returned: 0 in 0.945s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fd648435-34c2-4b66-9edd-0246444f63e4 tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:45 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d Jul 08 14:40:45 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:45 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9d72a40e-c62c-495a-a006-b3e542a03ccc tempest-GroupsTest-891437174 None] Update group completed successfully. Jul 08 14:40:45 devstack sudo[99001]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_f2_p8nfndevstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3" returned: 0 in 2.341s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:45 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_f2_p8nfndevstack@QuobyteHD, size 112.00 MB, duration 2.34 sec, destination /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:40:45 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Converted 112.00 MB image at 47.81 MB/s Jul 08 14:40:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:45 devstack sudo[99054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 1G Jul 08 14:40:45 devstack sudo[99054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:46 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fd648435-34c2-4b66-9edd-0246444f63e4 tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d" returned: 0 in 0.775s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fd648435-34c2-4b66-9edd-0246444f63e4 tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-quobyte-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d" released by "delete_volume" :: held 1.774s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:46 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-fd648435-34c2-4b66-9edd-0246444f63e4 tempest-VolumesDeleteCascade-1443573958 None] Created reservations ['0a39c5eb-61de-4c7f-82fc-70857d3f0225', '5248f5ef-739b-4826-86be-ddac38526f5e', '7edd4cf5-cfdc-4019-8f87-fc8c2c42b905', 'bbd8f412-1c72-4ef8-a246-2339551b8dd2'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:40:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fd648435-34c2-4b66-9edd-0246444f63e4 tempest-VolumesDeleteCascade-1443573958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fd648435-34c2-4b66-9edd-0246444f63e4 tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fd648435-34c2-4b66-9edd-0246444f63e4 tempest-VolumesDeleteCascade-1443573958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fd648435-34c2-4b66-9edd-0246444f63e4 tempest-VolumesDeleteCascade-1443573958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fd648435-34c2-4b66-9edd-0246444f63e4 tempest-VolumesDeleteCascade-1443573958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fd648435-34c2-4b66-9edd-0246444f63e4 tempest-VolumesDeleteCascade-1443573958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:46 devstack sudo[99057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:40:46 devstack sudo[99057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:46 devstack sudo[99054]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 1G" returned: 0 in 0.847s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:46 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[320b5728-acbb-4f6f-bf4c-5c6bc1ccd26a]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:46 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 Jul 08 14:40:46 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:47 devstack sudo[99057]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fd648435-34c2-4b66-9edd-0246444f63e4 tempest-VolumesDeleteCascade-1443573958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.863s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:47 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-fd648435-34c2-4b66-9edd-0246444f63e4 tempest-VolumesDeleteCascade-1443573958 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:40:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fd648435-34c2-4b66-9edd-0246444f63e4 tempest-VolumesDeleteCascade-1443573958 None] Deleted volume successfully. Jul 08 14:40:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] Acquiring lock "cinder-quobyte-15358c25-ccf7-4e71-9c37-7e7880ba06b6" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fd648435-34c2-4b66-9edd-0246444f63e4 tempest-VolumesDeleteCascade-1443573958 None] Lock "cinder-ea8c0ee0-60a2-4c4e-b47f-c8790699bf9d-delete_volume" released by "delete_volume" :: held 2.876s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] Lock "cinder-quobyte-15358c25-ccf7-4e71-9c37-7e7880ba06b6" acquired by "delete_volume" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:47 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc6ea5b-0563-4990-b3d6-78fe5aa5a3f3]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-15358c25-ccf7-4e71-9c37-7e7880ba06b6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:47 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-15358c25-ccf7-4e71-9c37-7e7880ba06b6 Jul 08 14:40:47 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:47 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3" returned: 0 in 1.014s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:47 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 Jul 08 14:40:47 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:48 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-15358c25-ccf7-4e71-9c37-7e7880ba06b6" returned: 0 in 0.947s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-15358c25-ccf7-4e71-9c37-7e7880ba06b6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:48 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-15358c25-ccf7-4e71-9c37-7e7880ba06b6 Jul 08 14:40:48 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:48 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3" returned: 1 in 0.912s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:40:48 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Downloaded image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 ((None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}])) to volume 65220a8f-7687-4ff2-b8f2-b8cbad29efd3 successfully. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 14:40:48 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Temporary image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 for user 2db3f49ad5124bb795e3d2664d1a0c57 is deleted. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 14:40:48 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Marking volume 65220a8f-7687-4ff2-b8f2-b8cbad29efd3 as bootable. {{(pid=87240) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 14:40:48 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Copying metadata from image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 to 65220a8f-7687-4ff2-b8f2-b8cbad29efd3. {{(pid=87240) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 14:40:48 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Creating volume glance metadata for volume 65220a8f-7687-4ff2-b8f2-b8cbad29efd3 backed by image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87240) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 14:40:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4516899-3788-43b6-ac3d-18e18dfa3e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3', 'volume_size': 1, 'image_id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f84c09b9fe464edfa51b7a3d44e3b143', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e28e4a-9c0f-4ec6-97da-0081b39cff28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:48 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Volume volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 (65220a8f-7687-4ff2-b8f2-b8cbad29efd3): created successfully Jul 08 14:40:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6e28e4a-9c0f-4ec6-97da-0081b39cff28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Flow 'volume_create_manager' (e0a48548-5ec0-47b8-a70c-b5a2e560348d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:40:48 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e7b351e1-ddeb-4622-a1ba-de8bb68cf778 tempest-VolumesExtendTest-1840880924 None] Created volume successfully. Jul 08 14:40:48 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-15358c25-ccf7-4e71-9c37-7e7880ba06b6" returned: 0 in 0.802s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] Lock "cinder-quobyte-15358c25-ccf7-4e71-9c37-7e7880ba06b6" released by "delete_volume" :: held 1.804s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] Acquiring lock "cinder-quobyte-5deac2f5-e6af-417d-849c-134128616bb1" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] Lock "cinder-quobyte-5deac2f5-e6af-417d-849c-134128616bb1" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:48 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b0e278-5abb-4cea-9084-55e93f4e61ee]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5deac2f5-e6af-417d-849c-134128616bb1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:49 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5deac2f5-e6af-417d-849c-134128616bb1 Jul 08 14:40:49 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:49 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5deac2f5-e6af-417d-849c-134128616bb1" returned: 0 in 0.867s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5deac2f5-e6af-417d-849c-134128616bb1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ade5b3b9-f706-4603-b601-72e7341c7ee2 tempest-VolumesExtendTest-1840880924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ade5b3b9-f706-4603-b601-72e7341c7ee2 tempest-VolumesExtendTest-1840880924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:49 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5deac2f5-e6af-417d-849c-134128616bb1 Jul 08 14:40:49 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:49 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0e30f3-7e60-4bc3-89a3-962cb27b80e1]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ade5b3b9-f706-4603-b601-72e7341c7ee2 tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:50 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 Jul 08 14:40:50 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:50 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:40:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Flow 'volume_create_manager' (a7f04b5a-4f61-4e49-80f3-298f0e6d4bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:40:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa6e554-ab1e-4b95-aec2-af9be01400c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daa6e554-ab1e-4b95-aec2-af9be01400c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1244868995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b875c609-e265-4f35-a205-c9d970a7839b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d7dbad980f4c2384d406790be5709c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:40:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:40:50Z,use_quota=True,user_id='67f126dc2bb34b71b9a382e4d1b60abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5266ce83-5204-4cbe-bc1a-af511fa424ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5266ce83-5204-4cbe-bc1a-af511fa424ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274cb5db-e591-4a94-9f2a-590e432ace80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (274cb5db-e591-4a94-9f2a-590e432ace80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b875c609-e265-4f35-a205-c9d970a7839b', 'volume_name': 'volume-b875c609-e265-4f35-a205-c9d970a7839b', 'volume_size': 2}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4063c1e1-b6e1-4697-8666-3cddcfd0f159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4063c1e1-b6e1-4697-8666-3cddcfd0f159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9a794a-1a5f-4b62-a542-5e6ac4e4f4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:50 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Volume b875c609-e265-4f35-a205-c9d970a7839b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b875c609-e265-4f35-a205-c9d970a7839b', 'volume_size': 2} Jul 08 14:40:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:50 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5deac2f5-e6af-417d-849c-134128616bb1" returned: 0 in 0.871s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] Lock "cinder-quobyte-5deac2f5-e6af-417d-849c-134128616bb1" released by "delete_volume" :: held 1.797s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:50 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ade5b3b9-f706-4603-b601-72e7341c7ee2 tempest-VolumesExtendTest-1840880924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3" returned: 0 in 0.864s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ade5b3b9-f706-4603-b601-72e7341c7ee2 tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:50 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] Created reservations ['fbcd7a28-f7df-4d85-b4ee-1bba5434677d'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:40:50 devstack cinder-volume[87240]: WARNING cinder.quota [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-428384018 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-428384018, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:40:50 devstack cinder-volume[87240]: WARNING cinder.quota [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-428384018 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-428384018, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:40:50 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] Created reservations ['22f89146-8fae-41ca-a601-ecf13b02362d', '295257e6-fa52-4afb-b7a8-276e2128a7dd', 'cf9032a2-c341-434f-8d93-e1bbb7d4c2c1', 'd1f74270-ee5d-4b35-9155-7fd011e56f28'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:40:50 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 Jul 08 14:40:50 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] Created reservations ['44c96ce4-6f21-41e9-9d69-7024e5b5e618', 'c4a5839f-69ba-4b86-86b1-293a46d719d3', 'a4cce88f-49ec-4931-9de6-87e6c7f7882f', 'defa299a-489f-4430-b776-d7f3024b44cb'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:51 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:40:51 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:51 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ade5b3b9-f706-4603-b601-72e7341c7ee2 tempest-VolumesExtendTest-1840880924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3" returned: 1 in 0.969s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ade5b3b9-f706-4603-b601-72e7341c7ee2 tempest-VolumesExtendTest-1840880924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ade5b3b9-f706-4603-b601-72e7341c7ee2 tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 2G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ade5b3b9-f706-4603-b601-72e7341c7ee2 tempest-VolumesExtendTest-1840880924 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 2G" returned: 0 in 0.082s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ade5b3b9-f706-4603-b601-72e7341c7ee2 tempest-VolumesExtendTest-1840880924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.977s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.562s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1244868995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b875c609-e265-4f35-a205-c9d970a7839b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6d7dbad980f4c2384d406790be5709c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:40:50Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:40:50Z,use_quota=True,user_id='67f126dc2bb34b71b9a382e4d1b60abf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Creating volume b875c609-e265-4f35-a205-c9d970a7839b {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:40:51 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b875c609-e265-4f35-a205-c9d970a7839b 2147483648 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:51 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b875c609-e265-4f35-a205-c9d970a7839b 2147483648 Jul 08 14:40:51 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:51 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.718s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:51 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:40:51 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ade5b3b9-f706-4603-b601-72e7341c7ee2 tempest-VolumesExtendTest-1840880924 None] Extend volume completed successfully. Jul 08 14:40:51 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5428ebcf-2e99-438a-ac7b-4b3aa1a6ebd2 tempest-GroupsTest-891437174 None] Delete group completed successfully. Jul 08 14:40:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0f63e51c-5007-4f75-8b4a-390e43616365 tempest-VolumesExtendTest-1840880924 None] Acquiring lock "cinder-65220a8f-7687-4ff2-b8f2-b8cbad29efd3-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0f63e51c-5007-4f75-8b4a-390e43616365 tempest-VolumesExtendTest-1840880924 None] Lock "cinder-65220a8f-7687-4ff2-b8f2-b8cbad29efd3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0f63e51c-5007-4f75-8b4a-390e43616365 tempest-VolumesExtendTest-1840880924 None] Acquiring lock "cinder-quobyte-65220a8f-7687-4ff2-b8f2-b8cbad29efd3" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0f63e51c-5007-4f75-8b4a-390e43616365 tempest-VolumesExtendTest-1840880924 None] Lock "cinder-quobyte-65220a8f-7687-4ff2-b8f2-b8cbad29efd3" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:52 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b2ba6d-f04c-4d42-894b-d81bc3441eeb]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0f63e51c-5007-4f75-8b4a-390e43616365 tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:52 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 Jul 08 14:40:52 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:53 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b875c609-e265-4f35-a205-c9d970a7839b 2147483648" returned: 0 in 1.173s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b875c609-e265-4f35-a205-c9d970a7839b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:53 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b875c609-e265-4f35-a205-c9d970a7839b Jul 08 14:40:53 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:53 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0f63e51c-5007-4f75-8b4a-390e43616365 tempest-VolumesExtendTest-1840880924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3" returned: 0 in 0.976s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0f63e51c-5007-4f75-8b4a-390e43616365 tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:53 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 Jul 08 14:40:53 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:53 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b875c609-e265-4f35-a205-c9d970a7839b" returned: 0 in 0.767s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:40:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.994s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9a794a-1a5f-4b62-a542-5e6ac4e4f4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b875c609-e265-4f35-a205-c9d970a7839b', 'volume_size': 2}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (377f180b-6974-4042-9798-182f441ebed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:53 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Volume volume-b875c609-e265-4f35-a205-c9d970a7839b (b875c609-e265-4f35-a205-c9d970a7839b): created successfully Jul 08 14:40:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (377f180b-6974-4042-9798-182f441ebed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Flow 'volume_create_manager' (a7f04b5a-4f61-4e49-80f3-298f0e6d4bb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:40:53 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d08cdd09-c4a9-40bf-87fc-d7636c351d8b tempest-VolumesCloneNegativeTest-1180261904 None] Created volume successfully. Jul 08 14:40:54 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0f63e51c-5007-4f75-8b4a-390e43616365 tempest-VolumesExtendTest-1840880924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3" returned: 1 in 0.836s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0f63e51c-5007-4f75-8b4a-390e43616365 tempest-VolumesExtendTest-1840880924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:40:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0f63e51c-5007-4f75-8b4a-390e43616365 tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:54 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3 Jul 08 14:40:54 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aa8568a1-8eac-43e6-ad9a-d146ffd1f94e tempest-VolumesCloneNegativeTest-1180261904 None] Acquiring lock "cinder-b875c609-e265-4f35-a205-c9d970a7839b-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aa8568a1-8eac-43e6-ad9a-d146ffd1f94e tempest-VolumesCloneNegativeTest-1180261904 None] Lock "cinder-b875c609-e265-4f35-a205-c9d970a7839b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aa8568a1-8eac-43e6-ad9a-d146ffd1f94e tempest-VolumesCloneNegativeTest-1180261904 None] Acquiring lock "cinder-quobyte-b875c609-e265-4f35-a205-c9d970a7839b" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:40:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aa8568a1-8eac-43e6-ad9a-d146ffd1f94e tempest-VolumesCloneNegativeTest-1180261904 None] Lock "cinder-quobyte-b875c609-e265-4f35-a205-c9d970a7839b" acquired by "delete_volume" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:40:54 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d286d4e-4854-471e-b67c-92ff8832d4e9]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa8568a1-8eac-43e6-ad9a-d146ffd1f94e tempest-VolumesCloneNegativeTest-1180261904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b875c609-e265-4f35-a205-c9d970a7839b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:54 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b875c609-e265-4f35-a205-c9d970a7839b Jul 08 14:40:54 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:55 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0f63e51c-5007-4f75-8b4a-390e43616365 tempest-VolumesExtendTest-1840880924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-65220a8f-7687-4ff2-b8f2-b8cbad29efd3" returned: 0 in 0.776s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0f63e51c-5007-4f75-8b4a-390e43616365 tempest-VolumesExtendTest-1840880924 None] Lock "cinder-quobyte-65220a8f-7687-4ff2-b8f2-b8cbad29efd3" released by "delete_volume" :: held 2.696s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:55 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-0f63e51c-5007-4f75-8b4a-390e43616365 tempest-VolumesExtendTest-1840880924 None] Created reservations ['67de7f96-1dc0-4112-a372-30280c6cf4dc', 'c547e328-3e13-4f22-91ab-7fd566e0a6d4', '4c787d4d-df41-467b-a694-2776605471fb', '94b8efbe-5518-47c7-9fdc-6d37196b0835'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:40:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0f63e51c-5007-4f75-8b4a-390e43616365 tempest-VolumesExtendTest-1840880924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0f63e51c-5007-4f75-8b4a-390e43616365 tempest-VolumesExtendTest-1840880924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0f63e51c-5007-4f75-8b4a-390e43616365 tempest-VolumesExtendTest-1840880924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0f63e51c-5007-4f75-8b4a-390e43616365 tempest-VolumesExtendTest-1840880924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0f63e51c-5007-4f75-8b4a-390e43616365 tempest-VolumesExtendTest-1840880924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0f63e51c-5007-4f75-8b4a-390e43616365 tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:55 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:40:55 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:55 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa8568a1-8eac-43e6-ad9a-d146ffd1f94e tempest-VolumesCloneNegativeTest-1180261904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b875c609-e265-4f35-a205-c9d970a7839b" returned: 0 in 1.003s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa8568a1-8eac-43e6-ad9a-d146ffd1f94e tempest-VolumesCloneNegativeTest-1180261904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b875c609-e265-4f35-a205-c9d970a7839b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:55 devstack sudo[99142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b875c609-e265-4f35-a205-c9d970a7839b Jul 08 14:40:55 devstack sudo[99142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:56 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0f63e51c-5007-4f75-8b4a-390e43616365 tempest-VolumesExtendTest-1840880924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.033s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-0f63e51c-5007-4f75-8b4a-390e43616365 tempest-VolumesExtendTest-1840880924 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:40:56 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0f63e51c-5007-4f75-8b4a-390e43616365 tempest-VolumesExtendTest-1840880924 None] Deleted volume successfully. Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0f63e51c-5007-4f75-8b4a-390e43616365 tempest-VolumesExtendTest-1840880924 None] Lock "cinder-65220a8f-7687-4ff2-b8f2-b8cbad29efd3-delete_volume" released by "delete_volume" :: held 4.027s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Flow 'volume_create_manager' (a13381a7-accd-427b-9a91-dda1ad1ef9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2931d8-d4b4-4e28-9554-8f9c74ad105d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2931d8-d4b4-4e28-9554-8f9c74ad105d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-62408466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0fa604-42db-462e-9108-9e171f429ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ba41c38ee45408dacb18a48870092e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:40:56Z,use_quota=True,user_id='2db3f49ad5124bb795e3d2664d1a0c57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a070b9fe-7c00-4b31-8774-12989865167b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a070b9fe-7c00-4b31-8774-12989865167b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac1fa045-8abf-4665-93b6-6ded12829988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac1fa045-8abf-4665-93b6-6ded12829988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac0fa604-42db-462e-9108-9e171f429ab0', 'volume_name': 'volume-ac0fa604-42db-462e-9108-9e171f429ab0', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7315e149-e9ba-430c-8ace-4a8cd9333ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7315e149-e9ba-430c-8ace-4a8cd9333ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e9763bd-4876-4bc2-a78e-935e779773b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:56 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Volume ac0fa604-42db-462e-9108-9e171f429ab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac0fa604-42db-462e-9108-9e171f429ab0', 'volume_size': 1} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-62408466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac0fa604-42db-462e-9108-9e171f429ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ba41c38ee45408dacb18a48870092e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:40:56Z,use_quota=True,user_id='2db3f49ad5124bb795e3d2664d1a0c57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Creating volume ac0fa604-42db-462e-9108-9e171f429ab0 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:40:56 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:56 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0 1073741824 Jul 08 14:40:56 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:56 devstack sudo[99142]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa8568a1-8eac-43e6-ad9a-d146ffd1f94e tempest-VolumesCloneNegativeTest-1180261904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b875c609-e265-4f35-a205-c9d970a7839b" returned: 0 in 0.857s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aa8568a1-8eac-43e6-ad9a-d146ffd1f94e tempest-VolumesCloneNegativeTest-1180261904 None] Lock "cinder-quobyte-b875c609-e265-4f35-a205-c9d970a7839b" released by "delete_volume" :: held 1.920s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-aa8568a1-8eac-43e6-ad9a-d146ffd1f94e tempest-VolumesCloneNegativeTest-1180261904 None] Created reservations ['53d8a024-605b-420e-ab2a-21679a45709d', 'a36b3fa1-e68f-4c73-b217-902ad9f91993', 'e39c1f3e-3d00-448d-80d3-4d7a23016a32', '87e9016f-ecb3-43ed-a5b2-873359767f49'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aa8568a1-8eac-43e6-ad9a-d146ffd1f94e tempest-VolumesCloneNegativeTest-1180261904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aa8568a1-8eac-43e6-ad9a-d146ffd1f94e tempest-VolumesCloneNegativeTest-1180261904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aa8568a1-8eac-43e6-ad9a-d146ffd1f94e tempest-VolumesCloneNegativeTest-1180261904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aa8568a1-8eac-43e6-ad9a-d146ffd1f94e tempest-VolumesCloneNegativeTest-1180261904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aa8568a1-8eac-43e6-ad9a-d146ffd1f94e tempest-VolumesCloneNegativeTest-1180261904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa8568a1-8eac-43e6-ad9a-d146ffd1f94e tempest-VolumesCloneNegativeTest-1180261904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:56 devstack sudo[99149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:40:56 devstack sudo[99149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:57 devstack sudo[99149]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa8568a1-8eac-43e6-ad9a-d146ffd1f94e tempest-VolumesCloneNegativeTest-1180261904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.810s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:57 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-aa8568a1-8eac-43e6-ad9a-d146ffd1f94e tempest-VolumesCloneNegativeTest-1180261904 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:40:57 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-aa8568a1-8eac-43e6-ad9a-d146ffd1f94e tempest-VolumesCloneNegativeTest-1180261904 None] Deleted volume successfully. Jul 08 14:40:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aa8568a1-8eac-43e6-ad9a-d146ffd1f94e tempest-VolumesCloneNegativeTest-1180261904 None] Lock "cinder-b875c609-e265-4f35-a205-c9d970a7839b-delete_volume" released by "delete_volume" :: held 3.024s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:40:57 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0 1073741824" returned: 0 in 1.168s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:57 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0 Jul 08 14:40:57 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:58 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Jul 08 14:40:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0" returned: 0 in 0.846s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:40:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] <== create_volume: return (2076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:40:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.079s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e9763bd-4876-4bc2-a78e-935e779773b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac0fa604-42db-462e-9108-9e171f429ab0', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c893d4-3027-447a-b13b-885f8508e6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:40:58 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Volume volume-ac0fa604-42db-462e-9108-9e171f429ab0 (ac0fa604-42db-462e-9108-9e171f429ab0): created successfully Jul 08 14:40:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c893d4-3027-447a-b13b-885f8508e6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:40:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Flow 'volume_create_manager' (a13381a7-accd-427b-9a91-dda1ad1ef9a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:40:58 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bf020df9-1209-4ca6-ad05-ead79874701c tempest-VolumesExtendTest-1840880924 None] Created volume successfully. Jul 08 14:40:58 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0e925b88-7eba-4383-b38f-8b32fea33d50 tempest-GroupsV314Test-1813122099 None] Group tempest-GroupsV314Test-Group-87250607: creating Jul 08 14:40:58 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0e925b88-7eba-4383-b38f-8b32fea33d50 tempest-GroupsV314Test-1813122099 None] Group tempest-GroupsV314Test-Group-87250607: created successfully Jul 08 14:40:58 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0e925b88-7eba-4383-b38f-8b32fea33d50 tempest-GroupsV314Test-1813122099 None] Create group completed successfully. Jul 08 14:40:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:40:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:40:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:40:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:40:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:40:59 devstack sudo[99159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:40:59 devstack sudo[99159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:40:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6238c3e3-dd04-434f-8b77-3484ebe8749c tempest-VolumesExtendTest-1840880924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:40:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6238c3e3-dd04-434f-8b77-3484ebe8749c tempest-VolumesExtendTest-1840880924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:40:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6238c3e3-dd04-434f-8b77-3484ebe8749c tempest-VolumesExtendTest-1840880924 None] Creating offline snapshot 21b218e6-0d8a-4e0b-ba05-1cfa32bd8857 of volume ac0fa604-42db-462e-9108-9e171f429ab0 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:40:59 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7e3a44-2018-4af3-8352-ae873fa804b2]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:40:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6238c3e3-dd04-434f-8b77-3484ebe8749c tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:00 devstack sudo[99159]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.780s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:41:00 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0 Jul 08 14:41:00 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Flow 'volume_create_manager' (bf5efd99-715b-4b7c-966a-f4e8bd3bcbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb00b5e1-cbfb-4fde-bc29-a1b0ec0162c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb00b5e1-cbfb-4fde-bc29-a1b0ec0162c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1517845428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b0a949f-9541-4fed-89b1-b699c741e367,host='devstack@QuobyteHD#QuobyteHD',id=d04b3719-2504-49f1-97e1-0f6c4e0e022f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93dd5d5749714811823b1b03d75b681d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:41:01Z,use_quota=True,user_id='82bf58f23338485d9c629e8921ed12a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1c41655-e2cd-4647-a184-52e7227829bc),volume_type_id=b1c41655-e2cd-4647-a184-52e7227829bc)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e6b7e3-ee45-4bb4-83dc-a29d8caa0102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e6b7e3-ee45-4bb4-83dc-a29d8caa0102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b67d72b-aca2-4326-9f1d-1fa9c852718a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b67d72b-aca2-4326-9f1d-1fa9c852718a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd04b3719-2504-49f1-97e1-0f6c4e0e022f', 'volume_name': 'volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a333f03f-dfa1-444c-af17-03cb14faf261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a333f03f-dfa1-444c-af17-03cb14faf261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b057cc66-0cde-4c8b-a302-0bb68c5955a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:00 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Volume d04b3719-2504-49f1-97e1-0f6c4e0e022f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f', 'volume_size': 1} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Flow 'volume_create_manager' (74dc2c87-b45a-4469-8561-f768615d40eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d6bbd8-5da4-4515-8d53-98029098761e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73d6bbd8-5da4-4515-8d53-98029098761e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-250554082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7edef8-f2fb-419e-b959-55e8877e87b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f28afac0d5de4aa48734d4ddd4998163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:41:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:41:01Z,use_quota=True,user_id='03fd42c533f64a48807aa23485ba4a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8174ea-c740-48f9-a9af-b9465dad5a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be8174ea-c740-48f9-a9af-b9465dad5a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609decb9-ced5-48fa-8b74-85297ad8bcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609decb9-ced5-48fa-8b74-85297ad8bcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f7edef8-f2fb-419e-b959-55e8877e87b2', 'volume_name': 'volume-5f7edef8-f2fb-419e-b959-55e8877e87b2', 'volume_size': 2}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f59e621-083c-455f-af2d-79142f0a9c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f59e621-083c-455f-af2d-79142f0a9c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:00 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f946fa2b-2b81-450e-836b-98856b35b7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:00 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Volume 5f7edef8-f2fb-419e-b959-55e8877e87b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f7edef8-f2fb-419e-b959-55e8877e87b2', 'volume_size': 2} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6238c3e3-dd04-434f-8b77-3484ebe8749c tempest-VolumesExtendTest-1840880924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0" returned: 0 in 0.983s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6238c3e3-dd04-434f-8b77-3484ebe8749c tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.21b218e6-0d8a-4e0b-ba05-1cfa32bd8857 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:01 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.21b218e6-0d8a-4e0b-ba05-1cfa32bd8857 1G Jul 08 14:41:01 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:01 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6238c3e3-dd04-434f-8b77-3484ebe8749c tempest-VolumesExtendTest-1840880924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.21b218e6-0d8a-4e0b-ba05-1cfa32bd8857 1G" returned: 0 in 0.873s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6238c3e3-dd04-434f-8b77-3484ebe8749c tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac0fa604-42db-462e-9108-9e171f429ab0 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.21b218e6-0d8a-4e0b-ba05-1cfa32bd8857 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:01 devstack sudo[99173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac0fa604-42db-462e-9108-9e171f429ab0 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.21b218e6-0d8a-4e0b-ba05-1cfa32bd8857 Jul 08 14:41:01 devstack sudo[99173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:02 devstack sudo[99173]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6238c3e3-dd04-434f-8b77-3484ebe8749c tempest-VolumesExtendTest-1840880924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac0fa604-42db-462e-9108-9e171f429ab0 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.21b218e6-0d8a-4e0b-ba05-1cfa32bd8857" returned: 0 in 0.779s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:02 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-6238c3e3-dd04-434f-8b77-3484ebe8749c tempest-VolumesExtendTest-1840880924 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.21b218e6-0d8a-4e0b-ba05-1cfa32bd8857 is being set with open permissions: ugo+rw Jul 08 14:41:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6238c3e3-dd04-434f-8b77-3484ebe8749c tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.21b218e6-0d8a-4e0b-ba05-1cfa32bd8857 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:02 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.21b218e6-0d8a-4e0b-ba05-1cfa32bd8857 Jul 08 14:41:02 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:03 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6238c3e3-dd04-434f-8b77-3484ebe8749c tempest-VolumesExtendTest-1840880924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.21b218e6-0d8a-4e0b-ba05-1cfa32bd8857" returned: 0 in 0.752s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6238c3e3-dd04-434f-8b77-3484ebe8749c tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:03 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.info Jul 08 14:41:03 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:04 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6238c3e3-dd04-434f-8b77-3484ebe8749c tempest-VolumesExtendTest-1840880924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.info" returned: 0 in 0.771s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:04 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-6238c3e3-dd04-434f-8b77-3484ebe8749c tempest-VolumesExtendTest-1840880924 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.info is being set with open permissions: ugo+rw Jul 08 14:41:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6238c3e3-dd04-434f-8b77-3484ebe8749c tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:04 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.info Jul 08 14:41:04 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:04 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6238c3e3-dd04-434f-8b77-3484ebe8749c tempest-VolumesExtendTest-1840880924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.info" returned: 0 in 0.734s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6238c3e3-dd04-434f-8b77-3484ebe8749c tempest-VolumesExtendTest-1840880924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.031s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.234s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9b0a949f-9541-4fed-89b1-b699c741e367,created_at=2026-07-08T12:41:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1517845428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9b0a949f-9541-4fed-89b1-b699c741e367,host='devstack@QuobyteHD#QuobyteHD',id=d04b3719-2504-49f1-97e1-0f6c4e0e022f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93dd5d5749714811823b1b03d75b681d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:41:01Z,use_quota=True,user_id='82bf58f23338485d9c629e8921ed12a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1c41655-e2cd-4647-a184-52e7227829bc),volume_type_id=b1c41655-e2cd-4647-a184-52e7227829bc)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:41:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Creating volume d04b3719-2504-49f1-97e1-0f6c4e0e022f {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:41:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:41:04 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:41:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:05 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f 1073741824 Jul 08 14:41:05 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:05 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6238c3e3-dd04-434f-8b77-3484ebe8749c tempest-VolumesExtendTest-1840880924 None] Create snapshot completed successfully Jul 08 14:41:05 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f 1073741824" returned: 0 in 0.983s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:06 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f Jul 08 14:41:06 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1c9b9aa9-be05-492d-80f3-d2f574fd98eb tempest-VolumesExtendTest-1840880924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:06 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f" returned: 0 in 0.710s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:41:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.731s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-250554082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f7edef8-f2fb-419e-b959-55e8877e87b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f28afac0d5de4aa48734d4ddd4998163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:41:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:41:01Z,use_quota=True,user_id='03fd42c533f64a48807aa23485ba4a41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:41:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Creating volume 5f7edef8-f2fb-419e-b959-55e8877e87b2 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:41:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:41:06 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:41:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2 2147483648 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:06 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2 2147483648 Jul 08 14:41:06 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b057cc66-0cde-4c8b-a302-0bb68c5955a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5445511c-66aa-4072-a1f4-03eff94867df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:06 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Volume volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f (d04b3719-2504-49f1-97e1-0f6c4e0e022f): created successfully Jul 08 14:41:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5445511c-66aa-4072-a1f4-03eff94867df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Flow 'volume_create_manager' (bf5efd99-715b-4b7c-966a-f4e8bd3bcbf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:41:06 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3692a082-8ee9-42de-a368-07872f1b853e tempest-GroupsV314Test-1813122099 None] Created volume successfully. Jul 08 14:41:07 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2 2147483648" returned: 0 in 1.049s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:07 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2 Jul 08 14:41:07 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:08 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2" returned: 0 in 0.759s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:41:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1c9b9aa9-be05-492d-80f3-d2f574fd98eb tempest-VolumesExtendTest-1840880924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 2.291s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f946fa2b-2b81-450e-836b-98856b35b7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f7edef8-f2fb-419e-b959-55e8877e87b2', 'volume_size': 2}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf2ac42-8bea-4fd3-8685-5ebdd3ca13ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:08 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c04d865-2d97-4b93-a6c4-495a75a994e1]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1c9b9aa9-be05-492d-80f3-d2f574fd98eb tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:08 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Volume volume-5f7edef8-f2fb-419e-b959-55e8877e87b2 (5f7edef8-f2fb-419e-b959-55e8877e87b2): created successfully Jul 08 14:41:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf2ac42-8bea-4fd3-8685-5ebdd3ca13ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Flow 'volume_create_manager' (74dc2c87-b45a-4469-8561-f768615d40eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:41:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-013cca70-8309-4849-9b24-810c825d2114 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Created volume successfully. Jul 08 14:41:08 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0 Jul 08 14:41:08 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:09 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1c9b9aa9-be05-492d-80f3-d2f574fd98eb tempest-VolumesExtendTest-1840880924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0" returned: 0 in 0.904s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1c9b9aa9-be05-492d-80f3-d2f574fd98eb tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.21b218e6-0d8a-4e0b-ba05-1cfa32bd8857 2G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1c9b9aa9-be05-492d-80f3-d2f574fd98eb tempest-VolumesExtendTest-1840880924 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.21b218e6-0d8a-4e0b-ba05-1cfa32bd8857 2G" returned: 0 in 0.211s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1c9b9aa9-be05-492d-80f3-d2f574fd98eb tempest-VolumesExtendTest-1840880924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.179s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.760s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:09 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Cloning volume d04b3719-2504-49f1-97e1-0f6c4e0e022f to volume e2bf25d2-cdd9-40cb-a858-29d1e4589ccb Jul 08 14:41:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-136faa87-d610-4fcc-87a1-e9328ba68b3e tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Creating offline snapshot f2f6b021-14a8-4485-b825-247a03b05492 of volume d04b3719-2504-49f1-97e1-0f6c4e0e022f {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:41:09 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fed565-6363-464a-8c0a-744449e1a4a8]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:09 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-1c9b9aa9-be05-492d-80f3-d2f574fd98eb tempest-VolumesExtendTest-1840880924 None] Extend volume completed successfully. Jul 08 14:41:09 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f Jul 08 14:41:09 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:10 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f" returned: 0 in 0.832s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.f2f6b021-14a8-4485-b825-247a03b05492 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:10 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.f2f6b021-14a8-4485-b825-247a03b05492 1G Jul 08 14:41:10 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7d5c09a9-26d6-461e-b1de-af898f12bd7d tempest-VolumesExtendTest-1840880924 None] Acquiring lock "cinder-21b218e6-0d8a-4e0b-ba05-1cfa32bd8857-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7d5c09a9-26d6-461e-b1de-af898f12bd7d tempest-VolumesExtendTest-1840880924 None] Lock "cinder-21b218e6-0d8a-4e0b-ba05-1cfa32bd8857-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7d5c09a9-26d6-461e-b1de-af898f12bd7d tempest-VolumesExtendTest-1840880924 None] Acquiring lock "cinder-quobyte-ac0fa604-42db-462e-9108-9e171f429ab0" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7d5c09a9-26d6-461e-b1de-af898f12bd7d tempest-VolumesExtendTest-1840880924 None] Lock "cinder-quobyte-ac0fa604-42db-462e-9108-9e171f429ab0" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7d5c09a9-26d6-461e-b1de-af898f12bd7d tempest-VolumesExtendTest-1840880924 None] Acquiring lock "cinder-quobyte-21b218e6-0d8a-4e0b-ba05-1cfa32bd8857" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7d5c09a9-26d6-461e-b1de-af898f12bd7d tempest-VolumesExtendTest-1840880924 None] Lock "cinder-quobyte-21b218e6-0d8a-4e0b-ba05-1cfa32bd8857" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-7d5c09a9-26d6-461e-b1de-af898f12bd7d tempest-VolumesExtendTest-1840880924 None] Deleting offline snapshot 21b218e6-0d8a-4e0b-ba05-1cfa32bd8857 of volume ac0fa604-42db-462e-9108-9e171f429ab0 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:41:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-7d5c09a9-26d6-461e-b1de-af898f12bd7d tempest-VolumesExtendTest-1840880924 None] snapshot_file for this snap is: volume-ac0fa604-42db-462e-9108-9e171f429ab0.21b218e6-0d8a-4e0b-ba05-1cfa32bd8857 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:41:10 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0124af84-7360-49f4-ae06-8c53ef7aed6e]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7d5c09a9-26d6-461e-b1de-af898f12bd7d tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.21b218e6-0d8a-4e0b-ba05-1cfa32bd8857 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:10 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.21b218e6-0d8a-4e0b-ba05-1cfa32bd8857 Jul 08 14:41:10 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:11 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.f2f6b021-14a8-4485-b825-247a03b05492 1G" returned: 0 in 0.913s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.f2f6b021-14a8-4485-b825-247a03b05492 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:11 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.f2f6b021-14a8-4485-b825-247a03b05492 Jul 08 14:41:11 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:11 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7d5c09a9-26d6-461e-b1de-af898f12bd7d tempest-VolumesExtendTest-1840880924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.21b218e6-0d8a-4e0b-ba05-1cfa32bd8857" returned: 0 in 0.882s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-7d5c09a9-26d6-461e-b1de-af898f12bd7d tempest-VolumesExtendTest-1840880924 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac0fa604-42db-462e-9108-9e171f429ab0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:41:11 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8e0a05-f885-4c4f-a985-397213f50b2a]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7d5c09a9-26d6-461e-b1de-af898f12bd7d tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:11 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0 Jul 08 14:41:11 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:12 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.f2f6b021-14a8-4485-b825-247a03b05492" returned: 0 in 0.881s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:12 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.f2f6b021-14a8-4485-b825-247a03b05492 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:41:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.f2f6b021-14a8-4485-b825-247a03b05492 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:12 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.f2f6b021-14a8-4485-b825-247a03b05492 Jul 08 14:41:12 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:12 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7d5c09a9-26d6-461e-b1de-af898f12bd7d tempest-VolumesExtendTest-1840880924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0" returned: 0 in 0.854s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7d5c09a9-26d6-461e-b1de-af898f12bd7d tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.21b218e6-0d8a-4e0b-ba05-1cfa32bd8857 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:12 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.21b218e6-0d8a-4e0b-ba05-1cfa32bd8857 Jul 08 14:41:12 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:13 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.f2f6b021-14a8-4485-b825-247a03b05492" returned: 0 in 0.719s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:13 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.info Jul 08 14:41:13 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:13 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7d5c09a9-26d6-461e-b1de-af898f12bd7d tempest-VolumesExtendTest-1840880924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.21b218e6-0d8a-4e0b-ba05-1cfa32bd8857" returned: 0 in 0.852s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7d5c09a9-26d6-461e-b1de-af898f12bd7d tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.21b218e6-0d8a-4e0b-ba05-1cfa32bd8857 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:13 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.21b218e6-0d8a-4e0b-ba05-1cfa32bd8857 Jul 08 14:41:13 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:13 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.info" returned: 0 in 0.742s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:13 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:41:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:13 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.info Jul 08 14:41:13 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:14 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7d5c09a9-26d6-461e-b1de-af898f12bd7d tempest-VolumesExtendTest-1840880924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0.21b218e6-0d8a-4e0b-ba05-1cfa32bd8857" returned: 0 in 0.709s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7d5c09a9-26d6-461e-b1de-af898f12bd7d tempest-VolumesExtendTest-1840880924 None] Lock "cinder-quobyte-21b218e6-0d8a-4e0b-ba05-1cfa32bd8857" released by "_delete_snapshot" :: held 3.419s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7d5c09a9-26d6-461e-b1de-af898f12bd7d tempest-VolumesExtendTest-1840880924 None] Lock "cinder-quobyte-ac0fa604-42db-462e-9108-9e171f429ab0" released by "delete_snapshot" :: held 3.441s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:14 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-7d5c09a9-26d6-461e-b1de-af898f12bd7d tempest-VolumesExtendTest-1840880924 None] Created reservations ['d4b6c4fa-54dd-46f9-821b-f1c78f45a29c', '84d5ae74-7008-4a58-bd39-584661e25162', 'e985fbdb-855e-4b4d-b90a-26247e17f150', '8ee194dc-37b4-4f81-8fc2-cd885869ab46'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:41:14 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7d5c09a9-26d6-461e-b1de-af898f12bd7d tempest-VolumesExtendTest-1840880924 None] Delete snapshot completed successfully. Jul 08 14:41:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7d5c09a9-26d6-461e-b1de-af898f12bd7d tempest-VolumesExtendTest-1840880924 None] Lock "cinder-21b218e6-0d8a-4e0b-ba05-1cfa32bd8857-delete_snapshot" released by "delete_snapshot" :: held 3.613s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:14 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.info" returned: 0 in 0.666s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Acquiring lock "cinder-quobyte-e2bf25d2-cdd9-40cb-a858-29d1e4589ccb" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Lock "cinder-quobyte-e2bf25d2-cdd9-40cb-a858-29d1e4589ccb" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] snapshot: f2f6b021-14a8-4485-b825-247a03b05492, volume: e2bf25d2-cdd9-40cb-a858-29d1e4589ccb, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:41:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:14 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd630ff-6d9a-4bac-a837-2ed7d388d8d8]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.f2f6b021-14a8-4485-b825-247a03b05492 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:14 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.f2f6b021-14a8-4485-b825-247a03b05492 Jul 08 14:41:14 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c12a388d-900d-4685-81a9-e9b4cf50b7ce tempest-VolumesExtendTest-1840880924 None] Acquiring lock "cinder-ac0fa604-42db-462e-9108-9e171f429ab0-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c12a388d-900d-4685-81a9-e9b4cf50b7ce tempest-VolumesExtendTest-1840880924 None] Lock "cinder-ac0fa604-42db-462e-9108-9e171f429ab0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c12a388d-900d-4685-81a9-e9b4cf50b7ce tempest-VolumesExtendTest-1840880924 None] Acquiring lock "cinder-quobyte-ac0fa604-42db-462e-9108-9e171f429ab0" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c12a388d-900d-4685-81a9-e9b4cf50b7ce tempest-VolumesExtendTest-1840880924 None] Lock "cinder-quobyte-ac0fa604-42db-462e-9108-9e171f429ab0" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:15 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba7ddd0-41df-4f9c-9aac-0077222fd51f]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c12a388d-900d-4685-81a9-e9b4cf50b7ce tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:15 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0 Jul 08 14:41:15 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:15 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.f2f6b021-14a8-4485-b825-247a03b05492" returned: 0 in 0.845s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:41:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:41:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:41:15 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba36fa12-6b99-4b75-a3b1-5e45fbe7dfe9]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:15 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f Jul 08 14:41:15 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:16 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c12a388d-900d-4685-81a9-e9b4cf50b7ce tempest-VolumesExtendTest-1840880924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0" returned: 0 in 0.830s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c12a388d-900d-4685-81a9-e9b4cf50b7ce tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:16 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0 Jul 08 14:41:16 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:16 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f" returned: 0 in 0.898s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:16 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Path /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e2bf25d2-cdd9-40cb-a858-29d1e4589ccb not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:41:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e2bf25d2-cdd9-40cb-a858-29d1e4589ccb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:16 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e2bf25d2-cdd9-40cb-a858-29d1e4589ccb Jul 08 14:41:16 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:16 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c12a388d-900d-4685-81a9-e9b4cf50b7ce tempest-VolumesExtendTest-1840880924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ac0fa604-42db-462e-9108-9e171f429ab0" returned: 0 in 0.850s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c12a388d-900d-4685-81a9-e9b4cf50b7ce tempest-VolumesExtendTest-1840880924 None] Lock "cinder-quobyte-ac0fa604-42db-462e-9108-9e171f429ab0" released by "delete_volume" :: held 1.781s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:17 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-c12a388d-900d-4685-81a9-e9b4cf50b7ce tempest-VolumesExtendTest-1840880924 None] Created reservations ['2dbefdf5-6899-45e7-9c5a-113abad7f202', 'bd0cb7f8-6057-4079-ad59-be0a18f01d1e', 'cb0b702a-2a6c-43d4-915b-a2cd45b39f91', '333db6b3-9365-4f9a-a8ab-2af6b195a3aa'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:41:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c12a388d-900d-4685-81a9-e9b4cf50b7ce tempest-VolumesExtendTest-1840880924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c12a388d-900d-4685-81a9-e9b4cf50b7ce tempest-VolumesExtendTest-1840880924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c12a388d-900d-4685-81a9-e9b4cf50b7ce tempest-VolumesExtendTest-1840880924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c12a388d-900d-4685-81a9-e9b4cf50b7ce tempest-VolumesExtendTest-1840880924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c12a388d-900d-4685-81a9-e9b4cf50b7ce tempest-VolumesExtendTest-1840880924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c12a388d-900d-4685-81a9-e9b4cf50b7ce tempest-VolumesExtendTest-1840880924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:17 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:41:17 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:18 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c12a388d-900d-4685-81a9-e9b4cf50b7ce tempest-VolumesExtendTest-1840880924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.378s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:18 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-c12a388d-900d-4685-81a9-e9b4cf50b7ce tempest-VolumesExtendTest-1840880924 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:41:18 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c12a388d-900d-4685-81a9-e9b4cf50b7ce tempest-VolumesExtendTest-1840880924 None] Deleted volume successfully. Jul 08 14:41:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c12a388d-900d-4685-81a9-e9b4cf50b7ce tempest-VolumesExtendTest-1840880924 None] Lock "cinder-ac0fa604-42db-462e-9108-9e171f429ab0-delete_volume" released by "delete_volume" :: held 3.471s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:22 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e2bf25d2-cdd9-40cb-a858-29d1e4589ccb" returned: 0 in 5.696s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:22 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[57636679-8595-41df-a70d-1e961412522a]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:22 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f Jul 08 14:41:22 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:23 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f" returned: 0 in 1.102s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:23 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Image conversion details: src /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e2bf25d2-cdd9-40cb-a858-29d1e4589ccb {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:41:23 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Converted 1024.00 MB image at 179.76 MB/s Jul 08 14:41:23 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e2bf25d2-cdd9-40cb-a858-29d1e4589ccb is being set with open permissions: ugo+rw: NotImplementedError Jul 08 14:41:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e2bf25d2-cdd9-40cb-a858-29d1e4589ccb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:23 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e2bf25d2-cdd9-40cb-a858-29d1e4589ccb Jul 08 14:41:23 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:23 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:41:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Flow 'volume_create_manager' (84c12628-18f6-4986-9f30-494b3059253e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:41:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e677aae3-7e2d-4402-a2cc-1f21bcf05b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e677aae3-7e2d-4402-a2cc-1f21bcf05b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1067909018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d0be9b-a3b9-4194-9668-d572b67820f9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3c540366ab0046409c68a194c70c5eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:41:23Z,use_quota=True,user_id='b9771e9f58cf4fa296a9e34f46a93a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (581e3ac3-3bfa-4dd4-b886-08f664818e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (581e3ac3-3bfa-4dd4-b886-08f664818e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc29e9d-2b1b-418d-8253-613b5c497fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cc29e9d-2b1b-418d-8253-613b5c497fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55d0be9b-a3b9-4194-9668-d572b67820f9', 'volume_name': 'volume-55d0be9b-a3b9-4194-9668-d572b67820f9', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b154f2-e4ec-4592-8205-a1930ec05aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3b154f2-e4ec-4592-8205-a1930ec05aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5ccd5b-342f-4066-a9c1-5eb65af18cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:23 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Volume 55d0be9b-a3b9-4194-9668-d572b67820f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55d0be9b-a3b9-4194-9668-d572b67820f9', 'volume_size': 1} Jul 08 14:41:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:24 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e2bf25d2-cdd9-40cb-a858-29d1e4589ccb" returned: 0 in 0.793s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Lock "cinder-quobyte-e2bf25d2-cdd9-40cb-a858-29d1e4589ccb" released by "_copy_volume_from_snapshot" :: held 9.425s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Acquiring lock "cinder-quobyte-f2f6b021-14a8-4485-b825-247a03b05492" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Lock "cinder-quobyte-f2f6b021-14a8-4485-b825-247a03b05492" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Deleting offline snapshot f2f6b021-14a8-4485-b825-247a03b05492 of volume d04b3719-2504-49f1-97e1-0f6c4e0e022f {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:41:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] snapshot_file for this snap is: volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.f2f6b021-14a8-4485-b825-247a03b05492 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:41:24 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[85760bd5-2b45-45d0-949d-50475cfcd992]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.f2f6b021-14a8-4485-b825-247a03b05492 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:24 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.f2f6b021-14a8-4485-b825-247a03b05492 Jul 08 14:41:24 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:24 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.f2f6b021-14a8-4485-b825-247a03b05492" returned: 0 in 0.820s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:41:24 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9073304-7a89-49bb-b021-a21df2a4d518]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:25 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f Jul 08 14:41:25 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:25 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f" returned: 0 in 0.825s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.f2f6b021-14a8-4485-b825-247a03b05492 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:25 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.f2f6b021-14a8-4485-b825-247a03b05492 Jul 08 14:41:25 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:26 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.f2f6b021-14a8-4485-b825-247a03b05492" returned: 0 in 0.784s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.f2f6b021-14a8-4485-b825-247a03b05492 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:26 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.f2f6b021-14a8-4485-b825-247a03b05492 Jul 08 14:41:26 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:27 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f.f2f6b021-14a8-4485-b825-247a03b05492" returned: 0 in 0.691s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Lock "cinder-quobyte-f2f6b021-14a8-4485-b825-247a03b05492" released by "_delete_snapshot" :: held 3.224s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:27 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=110,cinder:SELECT=94,cinder:DELETE=8,cinder:INSERT=37 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:41:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.600s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-136faa87-d610-4fcc-87a1-e9328ba68b3e tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 17.568s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-136faa87-d610-4fcc-87a1-e9328ba68b3e tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Creating offline snapshot 21b91f3d-01ac-46c4-bffe-d2b187c4b888 of volume 5f7edef8-f2fb-419e-b959-55e8877e87b2 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:41:27 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d4e795-afa5-43f2-b35d-3178f2dbe555]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-136faa87-d610-4fcc-87a1-e9328ba68b3e tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:27 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b2d6d03e-5963-471c-8f10-a7097bf30729 tempest-GroupsV314Test-1813122099 None] Create group from source-group-9b0a949f-9541-4fed-89b1-b699c741e367 completed successfully. Jul 08 14:41:27 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2 Jul 08 14:41:27 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:28 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-136faa87-d610-4fcc-87a1-e9328ba68b3e tempest-VolumesSnapshotNegativeTestJSON-256327512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2" returned: 0 in 0.821s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-136faa87-d610-4fcc-87a1-e9328ba68b3e tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.21b91f3d-01ac-46c4-bffe-d2b187c4b888 2G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:28 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.21b91f3d-01ac-46c4-bffe-d2b187c4b888 2G Jul 08 14:41:28 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-47f4d0be-5881-4cb6-b8b6-175e9157115c tempest-GroupsV314Test-1813122099 None] Acquiring lock "cinder-quobyte-e2bf25d2-cdd9-40cb-a858-29d1e4589ccb" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-47f4d0be-5881-4cb6-b8b6-175e9157115c tempest-GroupsV314Test-1813122099 None] Lock "cinder-quobyte-e2bf25d2-cdd9-40cb-a858-29d1e4589ccb" acquired by "delete_volume" :: waited 0.036s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:28 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0318cb3-ea57-4c24-bde3-5fd2e8ed34c6]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-47f4d0be-5881-4cb6-b8b6-175e9157115c tempest-GroupsV314Test-1813122099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e2bf25d2-cdd9-40cb-a858-29d1e4589ccb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:28 devstack sudo[99325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e2bf25d2-cdd9-40cb-a858-29d1e4589ccb Jul 08 14:41:28 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:29 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-136faa87-d610-4fcc-87a1-e9328ba68b3e tempest-VolumesSnapshotNegativeTestJSON-256327512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.21b91f3d-01ac-46c4-bffe-d2b187c4b888 2G" returned: 0 in 0.957s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-136faa87-d610-4fcc-87a1-e9328ba68b3e tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f7edef8-f2fb-419e-b959-55e8877e87b2 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.21b91f3d-01ac-46c4-bffe-d2b187c4b888 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:29 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f7edef8-f2fb-419e-b959-55e8877e87b2 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.21b91f3d-01ac-46c4-bffe-d2b187c4b888 Jul 08 14:41:29 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:29 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-47f4d0be-5881-4cb6-b8b6-175e9157115c tempest-GroupsV314Test-1813122099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e2bf25d2-cdd9-40cb-a858-29d1e4589ccb" returned: 0 in 0.870s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-47f4d0be-5881-4cb6-b8b6-175e9157115c tempest-GroupsV314Test-1813122099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e2bf25d2-cdd9-40cb-a858-29d1e4589ccb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:29 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e2bf25d2-cdd9-40cb-a858-29d1e4589ccb Jul 08 14:41:29 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:29 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-136faa87-d610-4fcc-87a1-e9328ba68b3e tempest-VolumesSnapshotNegativeTestJSON-256327512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5f7edef8-f2fb-419e-b959-55e8877e87b2 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.21b91f3d-01ac-46c4-bffe-d2b187c4b888" returned: 0 in 0.776s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:29 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-136faa87-d610-4fcc-87a1-e9328ba68b3e tempest-VolumesSnapshotNegativeTestJSON-256327512 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.21b91f3d-01ac-46c4-bffe-d2b187c4b888 is being set with open permissions: ugo+rw Jul 08 14:41:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-136faa87-d610-4fcc-87a1-e9328ba68b3e tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.21b91f3d-01ac-46c4-bffe-d2b187c4b888 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:29 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.21b91f3d-01ac-46c4-bffe-d2b187c4b888 Jul 08 14:41:29 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:30 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-47f4d0be-5881-4cb6-b8b6-175e9157115c tempest-GroupsV314Test-1813122099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e2bf25d2-cdd9-40cb-a858-29d1e4589ccb" returned: 0 in 0.699s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:30 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-47f4d0be-5881-4cb6-b8b6-175e9157115c tempest-GroupsV314Test-1813122099 None] Lock "cinder-quobyte-e2bf25d2-cdd9-40cb-a858-29d1e4589ccb" released by "delete_volume" :: held 1.638s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:30 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-47f4d0be-5881-4cb6-b8b6-175e9157115c tempest-GroupsV314Test-1813122099 None] Created reservations ['ffa09be2-e3bd-406b-ab0b-a091ce2b3def'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:41:30 devstack cinder-volume[87240]: WARNING cinder.quota [None req-47f4d0be-5881-4cb6-b8b6-175e9157115c tempest-GroupsV314Test-1813122099 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1468047441 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1468047441, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:41:30 devstack cinder-volume[87240]: WARNING cinder.quota [None req-47f4d0be-5881-4cb6-b8b6-175e9157115c tempest-GroupsV314Test-1813122099 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1468047441 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1468047441, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:41:30 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-47f4d0be-5881-4cb6-b8b6-175e9157115c tempest-GroupsV314Test-1813122099 None] Created reservations ['12ad3cd1-79be-45bb-a84c-1d5a17f4bd3c', 'da996145-27e9-425b-a7c1-3ed63d880cb1', 'b9f4a5fe-1c57-476a-b827-20180fe06d2d', '9653375c-03e9-4182-b9da-622ad3329c65'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:41:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-47f4d0be-5881-4cb6-b8b6-175e9157115c tempest-GroupsV314Test-1813122099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-47f4d0be-5881-4cb6-b8b6-175e9157115c tempest-GroupsV314Test-1813122099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-47f4d0be-5881-4cb6-b8b6-175e9157115c tempest-GroupsV314Test-1813122099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-47f4d0be-5881-4cb6-b8b6-175e9157115c tempest-GroupsV314Test-1813122099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-47f4d0be-5881-4cb6-b8b6-175e9157115c tempest-GroupsV314Test-1813122099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-47f4d0be-5881-4cb6-b8b6-175e9157115c tempest-GroupsV314Test-1813122099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:30 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:41:30 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:30 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-136faa87-d610-4fcc-87a1-e9328ba68b3e tempest-VolumesSnapshotNegativeTestJSON-256327512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.21b91f3d-01ac-46c4-bffe-d2b187c4b888" returned: 0 in 0.729s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-136faa87-d610-4fcc-87a1-e9328ba68b3e tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:30 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.info Jul 08 14:41:30 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:31 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-47f4d0be-5881-4cb6-b8b6-175e9157115c tempest-GroupsV314Test-1813122099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.779s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:31 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-47f4d0be-5881-4cb6-b8b6-175e9157115c tempest-GroupsV314Test-1813122099 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:41:31 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-47f4d0be-5881-4cb6-b8b6-175e9157115c tempest-GroupsV314Test-1813122099 None] Delete group completed successfully. Jul 08 14:41:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-21135fe0-819c-4ee8-9e40-19a0e9292f86 tempest-GroupsV314Test-1813122099 None] Acquiring lock "cinder-quobyte-d04b3719-2504-49f1-97e1-0f6c4e0e022f" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-21135fe0-819c-4ee8-9e40-19a0e9292f86 tempest-GroupsV314Test-1813122099 None] Lock "cinder-quobyte-d04b3719-2504-49f1-97e1-0f6c4e0e022f" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:31 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[895e8534-e275-4f40-91e2-154c3e1c52d7]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-21135fe0-819c-4ee8-9e40-19a0e9292f86 tempest-GroupsV314Test-1813122099 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:31 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-136faa87-d610-4fcc-87a1-e9328ba68b3e tempest-VolumesSnapshotNegativeTestJSON-256327512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.info" returned: 0 in 0.785s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:31 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-136faa87-d610-4fcc-87a1-e9328ba68b3e tempest-VolumesSnapshotNegativeTestJSON-256327512 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.info is being set with open permissions: ugo+rw Jul 08 14:41:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-136faa87-d610-4fcc-87a1-e9328ba68b3e tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:31 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.info Jul 08 14:41:31 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:31 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f Jul 08 14:41:31 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:32 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-136faa87-d610-4fcc-87a1-e9328ba68b3e tempest-VolumesSnapshotNegativeTestJSON-256327512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.info" returned: 0 in 0.708s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-136faa87-d610-4fcc-87a1-e9328ba68b3e tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.901s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.635s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1067909018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d0be9b-a3b9-4194-9668-d572b67820f9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3c540366ab0046409c68a194c70c5eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:41:23Z,use_quota=True,user_id='b9771e9f58cf4fa296a9e34f46a93a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:41:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Creating volume 55d0be9b-a3b9-4194-9668-d572b67820f9 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:41:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:41:32 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:41:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-55d0be9b-a3b9-4194-9668-d572b67820f9 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:32 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-21135fe0-819c-4ee8-9e40-19a0e9292f86 tempest-GroupsV314Test-1813122099 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f" returned: 0 in 0.852s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-21135fe0-819c-4ee8-9e40-19a0e9292f86 tempest-GroupsV314Test-1813122099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:32 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-55d0be9b-a3b9-4194-9668-d572b67820f9 1073741824 Jul 08 14:41:32 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:32 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f Jul 08 14:41:32 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:32 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-136faa87-d610-4fcc-87a1-e9328ba68b3e tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Create snapshot completed successfully Jul 08 14:41:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb932480-a457-4ab7-a662-7ec86bc5816c tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Acquiring lock "cinder-21b91f3d-01ac-46c4-bffe-d2b187c4b888-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:33 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb932480-a457-4ab7-a662-7ec86bc5816c tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Lock "cinder-21b91f3d-01ac-46c4-bffe-d2b187c4b888-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:33 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb932480-a457-4ab7-a662-7ec86bc5816c tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Acquiring lock "cinder-quobyte-5f7edef8-f2fb-419e-b959-55e8877e87b2" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:33 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-21135fe0-819c-4ee8-9e40-19a0e9292f86 tempest-GroupsV314Test-1813122099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d04b3719-2504-49f1-97e1-0f6c4e0e022f" returned: 0 in 0.750s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:33 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb932480-a457-4ab7-a662-7ec86bc5816c tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Lock "cinder-quobyte-5f7edef8-f2fb-419e-b959-55e8877e87b2" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:33 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb932480-a457-4ab7-a662-7ec86bc5816c tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Acquiring lock "cinder-quobyte-21b91f3d-01ac-46c4-bffe-d2b187c4b888" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:33 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-21135fe0-819c-4ee8-9e40-19a0e9292f86 tempest-GroupsV314Test-1813122099 None] Lock "cinder-quobyte-d04b3719-2504-49f1-97e1-0f6c4e0e022f" released by "delete_volume" :: held 1.691s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:33 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb932480-a457-4ab7-a662-7ec86bc5816c tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Lock "cinder-quobyte-21b91f3d-01ac-46c4-bffe-d2b187c4b888" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-bb932480-a457-4ab7-a662-7ec86bc5816c tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Deleting offline snapshot 21b91f3d-01ac-46c4-bffe-d2b187c4b888 of volume 5f7edef8-f2fb-419e-b959-55e8877e87b2 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:41:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-bb932480-a457-4ab7-a662-7ec86bc5816c tempest-VolumesSnapshotNegativeTestJSON-256327512 None] snapshot_file for this snap is: volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.21b91f3d-01ac-46c4-bffe-d2b187c4b888 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:41:33 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6951fb-3f4c-42a6-96e7-c06a2262d208]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb932480-a457-4ab7-a662-7ec86bc5816c tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.21b91f3d-01ac-46c4-bffe-d2b187c4b888 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:33 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-21135fe0-819c-4ee8-9e40-19a0e9292f86 tempest-GroupsV314Test-1813122099 None] Created reservations ['3f977876-b85e-4025-a1ed-ececd02e2e5b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:41:33 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-21135fe0-819c-4ee8-9e40-19a0e9292f86 tempest-GroupsV314Test-1813122099 None] Created reservations ['c2359fcd-6826-4491-b976-67e3cdb5953d', '765d4ee8-808d-44fd-b35f-5e3d26609bc6', '3ada87af-2b17-4a8c-9361-ffa00d18b3be', '8714948e-dcbf-46ab-9299-e16f91df32b4'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:41:33 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.21b91f3d-01ac-46c4-bffe-d2b187c4b888 Jul 08 14:41:33 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:33 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-55d0be9b-a3b9-4194-9668-d572b67820f9 1073741824" returned: 0 in 1.052s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-55d0be9b-a3b9-4194-9668-d572b67820f9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-21135fe0-819c-4ee8-9e40-19a0e9292f86 tempest-GroupsV314Test-1813122099 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-21135fe0-819c-4ee8-9e40-19a0e9292f86 tempest-GroupsV314Test-1813122099 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-21135fe0-819c-4ee8-9e40-19a0e9292f86 tempest-GroupsV314Test-1813122099 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:33 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-55d0be9b-a3b9-4194-9668-d572b67820f9 Jul 08 14:41:33 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-21135fe0-819c-4ee8-9e40-19a0e9292f86 tempest-GroupsV314Test-1813122099 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-21135fe0-819c-4ee8-9e40-19a0e9292f86 tempest-GroupsV314Test-1813122099 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-21135fe0-819c-4ee8-9e40-19a0e9292f86 tempest-GroupsV314Test-1813122099 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:33 devstack sudo[99372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:41:33 devstack sudo[99372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:34 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb932480-a457-4ab7-a662-7ec86bc5816c tempest-VolumesSnapshotNegativeTestJSON-256327512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.21b91f3d-01ac-46c4-bffe-d2b187c4b888" returned: 0 in 0.926s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-bb932480-a457-4ab7-a662-7ec86bc5816c tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5f7edef8-f2fb-419e-b959-55e8877e87b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:41:34 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-55d0be9b-a3b9-4194-9668-d572b67820f9" returned: 0 in 0.721s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:41:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:34 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[562c9e46-d240-4043-bba2-71bbb45add16]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb932480-a457-4ab7-a662-7ec86bc5816c tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5ccd5b-342f-4066-a9c1-5eb65af18cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d0be9b-a3b9-4194-9668-d572b67820f9', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d169f418-7c03-462b-b5d1-e6daa56d9a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:34 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Volume volume-55d0be9b-a3b9-4194-9668-d572b67820f9 (55d0be9b-a3b9-4194-9668-d572b67820f9): created successfully Jul 08 14:41:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d169f418-7c03-462b-b5d1-e6daa56d9a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Flow 'volume_create_manager' (84c12628-18f6-4986-9f30-494b3059253e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:41:34 devstack sudo[99372]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:34 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-24da1930-5114-45b8-92e5-279a90a507d0 tempest-VolumesGetTest-146683015 None] Created volume successfully. Jul 08 14:41:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-21135fe0-819c-4ee8-9e40-19a0e9292f86 tempest-GroupsV314Test-1813122099 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.814s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:34 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-21135fe0-819c-4ee8-9e40-19a0e9292f86 tempest-GroupsV314Test-1813122099 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:41:34 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-21135fe0-819c-4ee8-9e40-19a0e9292f86 tempest-GroupsV314Test-1813122099 None] Delete group completed successfully. Jul 08 14:41:34 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2 Jul 08 14:41:34 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:35 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb932480-a457-4ab7-a662-7ec86bc5816c tempest-VolumesSnapshotNegativeTestJSON-256327512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2" returned: 0 in 0.902s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb932480-a457-4ab7-a662-7ec86bc5816c tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.21b91f3d-01ac-46c4-bffe-d2b187c4b888 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:35 devstack sudo[99385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.21b91f3d-01ac-46c4-bffe-d2b187c4b888 Jul 08 14:41:35 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:35 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb932480-a457-4ab7-a662-7ec86bc5816c tempest-VolumesSnapshotNegativeTestJSON-256327512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.21b91f3d-01ac-46c4-bffe-d2b187c4b888" returned: 0 in 0.922s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb932480-a457-4ab7-a662-7ec86bc5816c tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.21b91f3d-01ac-46c4-bffe-d2b187c4b888 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:35 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.21b91f3d-01ac-46c4-bffe-d2b187c4b888 Jul 08 14:41:35 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Flow 'volume_create_manager' (96e5a82a-4290-453f-9c01-fa821ec8910d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfd2dd3-5ca7-4051-aa42-f70131ed33fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfd2dd3-5ca7-4051-aa42-f70131ed33fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:41:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1661002492',display_name='tempest-VolumesGetTest-Volume-2098908855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51bd2f1d-0d0f-4412-9823-54ff6b03fa58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c540366ab0046409c68a194c70c5eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:41:36Z,use_quota=True,user_id='b9771e9f58cf4fa296a9e34f46a93a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7930ee7-6e4c-48f3-96ea-92cbc20996dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7930ee7-6e4c-48f3-96ea-92cbc20996dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f69545-58aa-4b81-a1ac-8f98231633bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f69545-58aa-4b81-a1ac-8f98231633bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51bd2f1d-0d0f-4412-9823-54ff6b03fa58', 'volume_name': 'volume-51bd2f1d-0d0f-4412-9823-54ff6b03fa58', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b9abec-3186-4ebe-89ba-3615eb781e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35b9abec-3186-4ebe-89ba-3615eb781e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c188240f-00ea-47c2-a78a-bdb01aee5e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:36 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Volume 51bd2f1d-0d0f-4412-9823-54ff6b03fa58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51bd2f1d-0d0f-4412-9823-54ff6b03fa58', 'volume_size': 1} Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:41:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1661002492',display_name='tempest-VolumesGetTest-Volume-2098908855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51bd2f1d-0d0f-4412-9823-54ff6b03fa58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c540366ab0046409c68a194c70c5eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:41:36Z,use_quota=True,user_id='b9771e9f58cf4fa296a9e34f46a93a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Creating volume 51bd2f1d-0d0f-4412-9823-54ff6b03fa58 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:41:36 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-51bd2f1d-0d0f-4412-9823-54ff6b03fa58 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:36 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-51bd2f1d-0d0f-4412-9823-54ff6b03fa58 1073741824 Jul 08 14:41:36 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:36 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bb932480-a457-4ab7-a662-7ec86bc5816c tempest-VolumesSnapshotNegativeTestJSON-256327512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2.21b91f3d-01ac-46c4-bffe-d2b187c4b888" returned: 0 in 0.772s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb932480-a457-4ab7-a662-7ec86bc5816c tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Lock "cinder-quobyte-21b91f3d-01ac-46c4-bffe-d2b187c4b888" released by "_delete_snapshot" :: held 3.673s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb932480-a457-4ab7-a662-7ec86bc5816c tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Lock "cinder-quobyte-5f7edef8-f2fb-419e-b959-55e8877e87b2" released by "delete_snapshot" :: held 3.716s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-bb932480-a457-4ab7-a662-7ec86bc5816c tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Created reservations ['8f786ac7-85b6-45fb-94fd-ab5f3bd7dc1f', '978f1384-bfd6-4273-b5a2-ca788153e7f3', '22d63ebe-4b38-4246-baed-21efb5867919', '25edae04-2cc4-44ca-ac62-734af3aa3054'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:41:36 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bb932480-a457-4ab7-a662-7ec86bc5816c tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Delete snapshot completed successfully. Jul 08 14:41:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-bb932480-a457-4ab7-a662-7ec86bc5816c tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Lock "cinder-21b91f3d-01ac-46c4-bffe-d2b187c4b888-delete_snapshot" released by "delete_snapshot" :: held 3.912s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-89885926-74ae-4387-8efd-4b01c521f027 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Acquiring lock "cinder-5f7edef8-f2fb-419e-b959-55e8877e87b2-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:37 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-51bd2f1d-0d0f-4412-9823-54ff6b03fa58 1073741824" returned: 0 in 1.032s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-89885926-74ae-4387-8efd-4b01c521f027 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Lock "cinder-5f7edef8-f2fb-419e-b959-55e8877e87b2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-51bd2f1d-0d0f-4412-9823-54ff6b03fa58 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-89885926-74ae-4387-8efd-4b01c521f027 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Acquiring lock "cinder-quobyte-5f7edef8-f2fb-419e-b959-55e8877e87b2" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:37 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-51bd2f1d-0d0f-4412-9823-54ff6b03fa58 Jul 08 14:41:37 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-89885926-74ae-4387-8efd-4b01c521f027 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Lock "cinder-quobyte-5f7edef8-f2fb-419e-b959-55e8877e87b2" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:37 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c07819-8a46-42c1-b28d-bd7965944a3c]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89885926-74ae-4387-8efd-4b01c521f027 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:37 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2 Jul 08 14:41:37 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:38 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-51bd2f1d-0d0f-4412-9823-54ff6b03fa58" returned: 0 in 0.737s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:41:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c188240f-00ea-47c2-a78a-bdb01aee5e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51bd2f1d-0d0f-4412-9823-54ff6b03fa58', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (538e18e0-0c85-4bd8-b935-38f712356b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:38 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Volume volume-51bd2f1d-0d0f-4412-9823-54ff6b03fa58 (51bd2f1d-0d0f-4412-9823-54ff6b03fa58): created successfully Jul 08 14:41:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (538e18e0-0c85-4bd8-b935-38f712356b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Flow 'volume_create_manager' (96e5a82a-4290-453f-9c01-fa821ec8910d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:41:38 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4ee641dd-1896-40f6-826c-622a472dca76 tempest-VolumesGetTest-146683015 None] Created volume successfully. Jul 08 14:41:38 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89885926-74ae-4387-8efd-4b01c521f027 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2" returned: 0 in 0.853s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89885926-74ae-4387-8efd-4b01c521f027 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:38 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2 Jul 08 14:41:38 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:39 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89885926-74ae-4387-8efd-4b01c521f027 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5f7edef8-f2fb-419e-b959-55e8877e87b2" returned: 0 in 0.694s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-89885926-74ae-4387-8efd-4b01c521f027 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Lock "cinder-quobyte-5f7edef8-f2fb-419e-b959-55e8877e87b2" released by "delete_volume" :: held 1.624s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:39 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-89885926-74ae-4387-8efd-4b01c521f027 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Created reservations ['18af001c-6a5f-4bc9-8f63-367476c464c9', '9d8c5e06-bc3c-4a83-a46d-b96b2ccb9626', '0ed05733-6f61-461f-b2bf-b3b6a63bacea', '5dc0a252-e2ba-4a2f-846c-6066abfcaedd'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:41:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-89885926-74ae-4387-8efd-4b01c521f027 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-89885926-74ae-4387-8efd-4b01c521f027 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-89885926-74ae-4387-8efd-4b01c521f027 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-89885926-74ae-4387-8efd-4b01c521f027 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-89885926-74ae-4387-8efd-4b01c521f027 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89885926-74ae-4387-8efd-4b01c521f027 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:39 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:41:39 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6d6737bb-a52f-44a4-b4ac-562624eaa95d tempest-VolumesGetTest-146683015 None] Acquiring lock "cinder-51bd2f1d-0d0f-4412-9823-54ff6b03fa58-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6d6737bb-a52f-44a4-b4ac-562624eaa95d tempest-VolumesGetTest-146683015 None] Lock "cinder-51bd2f1d-0d0f-4412-9823-54ff6b03fa58-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6d6737bb-a52f-44a4-b4ac-562624eaa95d tempest-VolumesGetTest-146683015 None] Acquiring lock "cinder-quobyte-51bd2f1d-0d0f-4412-9823-54ff6b03fa58" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6d6737bb-a52f-44a4-b4ac-562624eaa95d tempest-VolumesGetTest-146683015 None] Lock "cinder-quobyte-51bd2f1d-0d0f-4412-9823-54ff6b03fa58" acquired by "delete_volume" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:39 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[558ede67-2a2c-40c4-a4e3-9045e74e5314]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d6737bb-a52f-44a4-b4ac-562624eaa95d tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-51bd2f1d-0d0f-4412-9823-54ff6b03fa58 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:39 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-51bd2f1d-0d0f-4412-9823-54ff6b03fa58 Jul 08 14:41:39 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:40 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89885926-74ae-4387-8efd-4b01c521f027 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.838s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:40 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-89885926-74ae-4387-8efd-4b01c521f027 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:41:40 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-89885926-74ae-4387-8efd-4b01c521f027 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Deleted volume successfully. Jul 08 14:41:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-89885926-74ae-4387-8efd-4b01c521f027 tempest-VolumesSnapshotNegativeTestJSON-256327512 None] Lock "cinder-5f7edef8-f2fb-419e-b959-55e8877e87b2-delete_volume" released by "delete_volume" :: held 2.760s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:40 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d6737bb-a52f-44a4-b4ac-562624eaa95d tempest-VolumesGetTest-146683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-51bd2f1d-0d0f-4412-9823-54ff6b03fa58" returned: 0 in 1.015s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d6737bb-a52f-44a4-b4ac-562624eaa95d tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-51bd2f1d-0d0f-4412-9823-54ff6b03fa58 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:40 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-51bd2f1d-0d0f-4412-9823-54ff6b03fa58 Jul 08 14:41:40 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:41 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d6737bb-a52f-44a4-b4ac-562624eaa95d tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-51bd2f1d-0d0f-4412-9823-54ff6b03fa58" returned: 0 in 0.898s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6d6737bb-a52f-44a4-b4ac-562624eaa95d tempest-VolumesGetTest-146683015 None] Lock "cinder-quobyte-51bd2f1d-0d0f-4412-9823-54ff6b03fa58" released by "delete_volume" :: held 1.978s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:41 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=116,cinder:INSERT=32,cinder:UPDATE=140,cinder:DELETE=7 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:41:41 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-6d6737bb-a52f-44a4-b4ac-562624eaa95d tempest-VolumesGetTest-146683015 None] Created reservations ['9cbf4a0e-1f90-4e1e-996b-3c0a07cd8bc3', '15e2f528-3c9c-444b-8d78-53762771a44e', 'e8256329-8582-4fa0-8dad-dd10db999d3d', '4ff6e89d-cfe3-42ab-927a-d0f8ef943900'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:41:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6d6737bb-a52f-44a4-b4ac-562624eaa95d tempest-VolumesGetTest-146683015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6d6737bb-a52f-44a4-b4ac-562624eaa95d tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6d6737bb-a52f-44a4-b4ac-562624eaa95d tempest-VolumesGetTest-146683015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6d6737bb-a52f-44a4-b4ac-562624eaa95d tempest-VolumesGetTest-146683015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6d6737bb-a52f-44a4-b4ac-562624eaa95d tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d6737bb-a52f-44a4-b4ac-562624eaa95d tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:41 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:41:41 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Flow 'volume_create_manager' (54e8aed7-f0d9-4e2b-bfe6-8d9cffc70e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae009fb9-ac31-4199-b983-7f0efe51971d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae009fb9-ac31-4199-b983-7f0efe51971d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1413325504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807ac68c-9be8-4af6-be3d-14b3b3ae1def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5409bcea9842728df8877e55888d36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:41:42Z,use_quota=True,user_id='b3937f5e915f457cb85ad1f94c5d0828',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162fd8f3-696d-4787-adac-43858f48c204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (162fd8f3-696d-4787-adac-43858f48c204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e317f7-ad06-4e6b-a41d-62e8666aea01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e317f7-ad06-4e6b-a41d-62e8666aea01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '807ac68c-9be8-4af6-be3d-14b3b3ae1def', 'volume_name': 'volume-807ac68c-9be8-4af6-be3d-14b3b3ae1def', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ca5274-f6fb-4c94-902d-238be32646e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16ca5274-f6fb-4c94-902d-238be32646e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66db4b91-c570-43c6-ba8d-88ee4a6bdc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:42 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Volume 807ac68c-9be8-4af6-be3d-14b3b3ae1def: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-807ac68c-9be8-4af6-be3d-14b3b3ae1def', 'volume_size': 1} Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1413325504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807ac68c-9be8-4af6-be3d-14b3b3ae1def,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5409bcea9842728df8877e55888d36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:41:42Z,use_quota=True,user_id='b3937f5e915f457cb85ad1f94c5d0828',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Creating volume 807ac68c-9be8-4af6-be3d-14b3b3ae1def {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:41:42 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-807ac68c-9be8-4af6-be3d-14b3b3ae1def 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:42 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-807ac68c-9be8-4af6-be3d-14b3b3ae1def 1073741824 Jul 08 14:41:42 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:42 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6d6737bb-a52f-44a4-b4ac-562624eaa95d tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.838s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-6d6737bb-a52f-44a4-b4ac-562624eaa95d tempest-VolumesGetTest-146683015 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:41:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6d6737bb-a52f-44a4-b4ac-562624eaa95d tempest-VolumesGetTest-146683015 None] Deleted volume successfully. Jul 08 14:41:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-6d6737bb-a52f-44a4-b4ac-562624eaa95d tempest-VolumesGetTest-146683015 None] Lock "cinder-51bd2f1d-0d0f-4412-9823-54ff6b03fa58-delete_volume" released by "delete_volume" :: held 3.200s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c6be7ec8-ce7c-4380-8fc6-bc079008e8e4 tempest-VolumesGetTest-146683015 None] Acquiring lock "cinder-55d0be9b-a3b9-4194-9668-d572b67820f9-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c6be7ec8-ce7c-4380-8fc6-bc079008e8e4 tempest-VolumesGetTest-146683015 None] Lock "cinder-55d0be9b-a3b9-4194-9668-d572b67820f9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c6be7ec8-ce7c-4380-8fc6-bc079008e8e4 tempest-VolumesGetTest-146683015 None] Acquiring lock "cinder-quobyte-55d0be9b-a3b9-4194-9668-d572b67820f9" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c6be7ec8-ce7c-4380-8fc6-bc079008e8e4 tempest-VolumesGetTest-146683015 None] Lock "cinder-quobyte-55d0be9b-a3b9-4194-9668-d572b67820f9" acquired by "delete_volume" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:43 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67f6545-9c2b-4ec0-a81b-a3e052013d8e]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c6be7ec8-ce7c-4380-8fc6-bc079008e8e4 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-55d0be9b-a3b9-4194-9668-d572b67820f9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:43 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-55d0be9b-a3b9-4194-9668-d572b67820f9 Jul 08 14:41:43 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:43 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-807ac68c-9be8-4af6-be3d-14b3b3ae1def 1073741824" returned: 0 in 1.187s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-807ac68c-9be8-4af6-be3d-14b3b3ae1def {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:43 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-807ac68c-9be8-4af6-be3d-14b3b3ae1def Jul 08 14:41:43 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:44 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c6be7ec8-ce7c-4380-8fc6-bc079008e8e4 tempest-VolumesGetTest-146683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-55d0be9b-a3b9-4194-9668-d572b67820f9" returned: 0 in 0.984s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c6be7ec8-ce7c-4380-8fc6-bc079008e8e4 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-55d0be9b-a3b9-4194-9668-d572b67820f9 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:44 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-55d0be9b-a3b9-4194-9668-d572b67820f9 Jul 08 14:41:44 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:44 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-807ac68c-9be8-4af6-be3d-14b3b3ae1def" returned: 0 in 0.938s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] <== create_volume: return (2182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:41:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.186s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66db4b91-c570-43c6-ba8d-88ee4a6bdc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-807ac68c-9be8-4af6-be3d-14b3b3ae1def', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc8b931-fcad-434c-bf0e-6df96dd4c98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:44 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Volume volume-807ac68c-9be8-4af6-be3d-14b3b3ae1def (807ac68c-9be8-4af6-be3d-14b3b3ae1def): created successfully Jul 08 14:41:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc8b931-fcad-434c-bf0e-6df96dd4c98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Flow 'volume_create_manager' (54e8aed7-f0d9-4e2b-bfe6-8d9cffc70e76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:41:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b7eabaea-8644-4627-9a59-849e47986d13 tempest-VolumeQuotasAdminTestJSON-168185669 None] Created volume successfully. Jul 08 14:41:45 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c6be7ec8-ce7c-4380-8fc6-bc079008e8e4 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-55d0be9b-a3b9-4194-9668-d572b67820f9" returned: 0 in 0.816s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c6be7ec8-ce7c-4380-8fc6-bc079008e8e4 tempest-VolumesGetTest-146683015 None] Lock "cinder-quobyte-55d0be9b-a3b9-4194-9668-d572b67820f9" released by "delete_volume" :: held 1.847s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:45 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-c6be7ec8-ce7c-4380-8fc6-bc079008e8e4 tempest-VolumesGetTest-146683015 None] Created reservations ['0bdb7caf-bb9d-41ce-9b33-9ddeb6676407', 'cc43accb-03df-4faf-ac58-322e140db394', '0a16a165-3077-4774-b175-aeb001038d62', '02e9e282-c16c-4bf6-a17a-5957e07471f5'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:41:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c6be7ec8-ce7c-4380-8fc6-bc079008e8e4 tempest-VolumesGetTest-146683015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c6be7ec8-ce7c-4380-8fc6-bc079008e8e4 tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c6be7ec8-ce7c-4380-8fc6-bc079008e8e4 tempest-VolumesGetTest-146683015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c6be7ec8-ce7c-4380-8fc6-bc079008e8e4 tempest-VolumesGetTest-146683015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c6be7ec8-ce7c-4380-8fc6-bc079008e8e4 tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c6be7ec8-ce7c-4380-8fc6-bc079008e8e4 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:45 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:41:45 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4e0fdf10-4e94-4fae-b315-fa09df9e7ef6 tempest-VolumeQuotasAdminTestJSON-168185669 None] Acquiring lock "cinder-807ac68c-9be8-4af6-be3d-14b3b3ae1def-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4e0fdf10-4e94-4fae-b315-fa09df9e7ef6 tempest-VolumeQuotasAdminTestJSON-168185669 None] Lock "cinder-807ac68c-9be8-4af6-be3d-14b3b3ae1def-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4e0fdf10-4e94-4fae-b315-fa09df9e7ef6 tempest-VolumeQuotasAdminTestJSON-168185669 None] Acquiring lock "cinder-quobyte-807ac68c-9be8-4af6-be3d-14b3b3ae1def" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4e0fdf10-4e94-4fae-b315-fa09df9e7ef6 tempest-VolumeQuotasAdminTestJSON-168185669 None] Lock "cinder-quobyte-807ac68c-9be8-4af6-be3d-14b3b3ae1def" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:45 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4debe874-1d58-4baf-9f31-fea4b0b00bd3]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4e0fdf10-4e94-4fae-b315-fa09df9e7ef6 tempest-VolumeQuotasAdminTestJSON-168185669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-807ac68c-9be8-4af6-be3d-14b3b3ae1def {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:45 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-807ac68c-9be8-4af6-be3d-14b3b3ae1def Jul 08 14:41:45 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Flow 'volume_create_manager' (b65522cc-36f0-4a65-9c45-1b4a2161e2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a61b7b-7460-49a1-ab06-cc88f8224666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a61b7b-7460-49a1-ab06-cc88f8224666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1753083457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bfd9b24-fa57-4304-bd81-f37509d5a028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c540366ab0046409c68a194c70c5eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:41:46Z,use_quota=True,user_id='b9771e9f58cf4fa296a9e34f46a93a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e2ac6c4-2389-4ee3-9309-da0526433b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e2ac6c4-2389-4ee3-9309-da0526433b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39f6899-ec3e-4fbd-abce-3f2cecc704bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39f6899-ec3e-4fbd-abce-3f2cecc704bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bfd9b24-fa57-4304-bd81-f37509d5a028', 'volume_name': 'volume-3bfd9b24-fa57-4304-bd81-f37509d5a028', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850a0c9f-ec29-4d7d-ae8a-dece4d169965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (850a0c9f-ec29-4d7d-ae8a-dece4d169965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f53f3d35-36c5-46f2-aea2-d1bd706ef9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:46 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Volume 3bfd9b24-fa57-4304-bd81-f37509d5a028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bfd9b24-fa57-4304-bd81-f37509d5a028', 'volume_size': 1} Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1753083457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bfd9b24-fa57-4304-bd81-f37509d5a028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c540366ab0046409c68a194c70c5eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:41:46Z,use_quota=True,user_id='b9771e9f58cf4fa296a9e34f46a93a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Creating volume 3bfd9b24-fa57-4304-bd81-f37509d5a028 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:41:46 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:41:46 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c6be7ec8-ce7c-4380-8fc6-bc079008e8e4 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.067s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-c6be7ec8-ce7c-4380-8fc6-bc079008e8e4 tempest-VolumesGetTest-146683015 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:41:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c6be7ec8-ce7c-4380-8fc6-bc079008e8e4 tempest-VolumesGetTest-146683015 None] Deleted volume successfully. Jul 08 14:41:46 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 1073741824 Jul 08 14:41:46 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c6be7ec8-ce7c-4380-8fc6-bc079008e8e4 tempest-VolumesGetTest-146683015 None] Lock "cinder-55d0be9b-a3b9-4194-9668-d572b67820f9-delete_volume" released by "delete_volume" :: held 3.200s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:46 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4e0fdf10-4e94-4fae-b315-fa09df9e7ef6 tempest-VolumeQuotasAdminTestJSON-168185669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-807ac68c-9be8-4af6-be3d-14b3b3ae1def" returned: 0 in 1.152s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4e0fdf10-4e94-4fae-b315-fa09df9e7ef6 tempest-VolumeQuotasAdminTestJSON-168185669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-807ac68c-9be8-4af6-be3d-14b3b3ae1def {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:46 devstack sudo[99489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-807ac68c-9be8-4af6-be3d-14b3b3ae1def Jul 08 14:41:46 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:47 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 1073741824" returned: 0 in 0.979s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:47 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 Jul 08 14:41:47 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:47 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4e0fdf10-4e94-4fae-b315-fa09df9e7ef6 tempest-VolumeQuotasAdminTestJSON-168185669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-807ac68c-9be8-4af6-be3d-14b3b3ae1def" returned: 0 in 0.868s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4e0fdf10-4e94-4fae-b315-fa09df9e7ef6 tempest-VolumeQuotasAdminTestJSON-168185669 None] Lock "cinder-quobyte-807ac68c-9be8-4af6-be3d-14b3b3ae1def" released by "delete_volume" :: held 2.118s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:47 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-4e0fdf10-4e94-4fae-b315-fa09df9e7ef6 tempest-VolumeQuotasAdminTestJSON-168185669 None] Created reservations ['abc2b6e8-12c0-4ca2-86f8-5705277c9865', '043fab5b-d4a6-4b4e-81be-87c84cd70676', '9c4b273d-a934-4ec2-a80d-a4072076e03d', '2f50d3d5-d219-4715-a991-bedf01db2e24'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:41:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4e0fdf10-4e94-4fae-b315-fa09df9e7ef6 tempest-VolumeQuotasAdminTestJSON-168185669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4e0fdf10-4e94-4fae-b315-fa09df9e7ef6 tempest-VolumeQuotasAdminTestJSON-168185669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4e0fdf10-4e94-4fae-b315-fa09df9e7ef6 tempest-VolumeQuotasAdminTestJSON-168185669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4e0fdf10-4e94-4fae-b315-fa09df9e7ef6 tempest-VolumeQuotasAdminTestJSON-168185669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4e0fdf10-4e94-4fae-b315-fa09df9e7ef6 tempest-VolumeQuotasAdminTestJSON-168185669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4e0fdf10-4e94-4fae-b315-fa09df9e7ef6 tempest-VolumeQuotasAdminTestJSON-168185669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:47 devstack sudo[99496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:41:47 devstack sudo[99496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:48 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028" returned: 0 in 0.831s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:41:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f53f3d35-36c5-46f2-aea2-d1bd706ef9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bfd9b24-fa57-4304-bd81-f37509d5a028', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9ff631-bd82-47a8-9547-1a4c8f60c592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:48 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Volume volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 (3bfd9b24-fa57-4304-bd81-f37509d5a028): created successfully Jul 08 14:41:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9ff631-bd82-47a8-9547-1a4c8f60c592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Flow 'volume_create_manager' (b65522cc-36f0-4a65-9c45-1b4a2161e2dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:41:48 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e5102232-8fcf-442b-957e-5e3aa0cce1a7 tempest-VolumesGetTest-146683015 None] Created volume successfully. Jul 08 14:41:48 devstack sudo[99496]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4e0fdf10-4e94-4fae-b315-fa09df9e7ef6 tempest-VolumeQuotasAdminTestJSON-168185669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.755s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:48 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-4e0fdf10-4e94-4fae-b315-fa09df9e7ef6 tempest-VolumeQuotasAdminTestJSON-168185669 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:41:48 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4e0fdf10-4e94-4fae-b315-fa09df9e7ef6 tempest-VolumeQuotasAdminTestJSON-168185669 None] Deleted volume successfully. Jul 08 14:41:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4e0fdf10-4e94-4fae-b315-fa09df9e7ef6 tempest-VolumeQuotasAdminTestJSON-168185669 None] Lock "cinder-807ac68c-9be8-4af6-be3d-14b3b3ae1def-delete_volume" released by "delete_volume" :: held 3.158s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Flow 'volume_create_manager' (f55c093f-ad60-4fc0-8e6e-f0086b0425c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa540c5-c55c-4690-8a49-13f1f288ecc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa540c5-c55c-4690-8a49-13f1f288ecc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1094125124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0dcf64a-356c-40cd-b362-d2fb51fada8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5409bcea9842728df8877e55888d36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:41:49Z,use_quota=True,user_id='b3937f5e915f457cb85ad1f94c5d0828',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1794028-273b-4815-9cb7-1ed74774dda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1794028-273b-4815-9cb7-1ed74774dda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdb7511-78b0-4ea2-b0ff-da170d024b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdb7511-78b0-4ea2-b0ff-da170d024b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0dcf64a-356c-40cd-b362-d2fb51fada8c', 'volume_name': 'volume-a0dcf64a-356c-40cd-b362-d2fb51fada8c', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c1a65a-18cd-4423-8f13-6a8ffd2edc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c1a65a-18cd-4423-8f13-6a8ffd2edc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba209cd-8132-4426-8e56-0793b58ee0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:49 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Volume a0dcf64a-356c-40cd-b362-d2fb51fada8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0dcf64a-356c-40cd-b362-d2fb51fada8c', 'volume_size': 1} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1094125124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0dcf64a-356c-40cd-b362-d2fb51fada8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b5409bcea9842728df8877e55888d36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:41:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:41:49Z,use_quota=True,user_id='b3937f5e915f457cb85ad1f94c5d0828',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Creating volume a0dcf64a-356c-40cd-b362-d2fb51fada8c {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:41:49 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a0dcf64a-356c-40cd-b362-d2fb51fada8c 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:49 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a0dcf64a-356c-40cd-b362-d2fb51fada8c 1073741824 Jul 08 14:41:49 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Flow 'volume_create_manager' (ca375321-f930-43e3-be14-75606f693d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92184e04-a405-49ea-8f68-5efde7b186e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92184e04-a405-49ea-8f68-5efde7b186e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:41:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1530937478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33b86528-c48d-4b62-adce-52c4ba7512fe,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3c540366ab0046409c68a194c70c5eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3bfd9b24-fa57-4304-bd81-f37509d5a028,status='creating',terminated_at=None,updated_at=2026-07-08T12:41:50Z,use_quota=True,user_id='b9771e9f58cf4fa296a9e34f46a93a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efdbce0e-195d-44ac-8cb0-1e0b348c2619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efdbce0e-195d-44ac-8cb0-1e0b348c2619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36fbcb75-7819-4731-86a2-847f11bdaab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36fbcb75-7819-4731-86a2-847f11bdaab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '33b86528-c48d-4b62-adce-52c4ba7512fe', 'volume_name': 'volume-33b86528-c48d-4b62-adce-52c4ba7512fe', 'volume_size': 1, 'source_volid': '3bfd9b24-fa57-4304-bd81-f37509d5a028', 'source_volstatus': 'available'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb0b137-3e89-4e86-af4d-a14bbef07b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb0b137-3e89-4e86-af4d-a14bbef07b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad74fad-28ba-4402-9259-4b41223d2dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:50 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Volume 33b86528-c48d-4b62-adce-52c4ba7512fe: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-33b86528-c48d-4b62-adce-52c4ba7512fe', 'volume_size': 1, 'source_volid': '3bfd9b24-fa57-4304-bd81-f37509d5a028', 'source_volstatus': 'available'} Jul 08 14:41:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:50 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a0dcf64a-356c-40cd-b362-d2fb51fada8c 1073741824" returned: 0 in 1.096s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a0dcf64a-356c-40cd-b362-d2fb51fada8c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:50 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a0dcf64a-356c-40cd-b362-d2fb51fada8c Jul 08 14:41:50 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:51 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a0dcf64a-356c-40cd-b362-d2fb51fada8c" returned: 0 in 0.746s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:41:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.915s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.566s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:51 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Cloning volume 3bfd9b24-fa57-4304-bd81-f37509d5a028 to volume 33b86528-c48d-4b62-adce-52c4ba7512fe Jul 08 14:41:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba209cd-8132-4426-8e56-0793b58ee0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0dcf64a-356c-40cd-b362-d2fb51fada8c', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef62e99-ea4d-4f5a-be04-5b5965a57faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:41:51 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Volume volume-a0dcf64a-356c-40cd-b362-d2fb51fada8c (a0dcf64a-356c-40cd-b362-d2fb51fada8c): created successfully Jul 08 14:41:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ef62e99-ea4d-4f5a-be04-5b5965a57faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:41:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Flow 'volume_create_manager' (f55c093f-ad60-4fc0-8e6e-f0086b0425c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:41:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Creating offline snapshot 89a877d2-2497-4baa-9b52-6c0d2a004fd5 of volume 3bfd9b24-fa57-4304-bd81-f37509d5a028 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:41:51 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3bd68465-5157-4b55-8619-5dcd6e54fb39 tempest-VolumeQuotasAdminTestJSON-168185669 None] Created volume successfully. Jul 08 14:41:51 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[860c9153-74c7-4be1-b805-0f90674eaab7]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:51 devstack sudo[99517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 Jul 08 14:41:51 devstack sudo[99517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:52 devstack sudo[99517]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028" returned: 0 in 0.938s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.89a877d2-2497-4baa-9b52-6c0d2a004fd5 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:52 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.89a877d2-2497-4baa-9b52-6c0d2a004fd5 1G Jul 08 14:41:52 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:53 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e68991a6-50c9-472b-be87-61286a196cf9 tempest-VolumeQuotasAdminTestJSON-176718085 None] Transfer volume completed successfully. Jul 08 14:41:53 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.89a877d2-2497-4baa-9b52-6c0d2a004fd5 1G" returned: 0 in 1.203s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.89a877d2-2497-4baa-9b52-6c0d2a004fd5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:53 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.89a877d2-2497-4baa-9b52-6c0d2a004fd5 Jul 08 14:41:53 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:54 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.89a877d2-2497-4baa-9b52-6c0d2a004fd5" returned: 0 in 0.813s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:54 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.89a877d2-2497-4baa-9b52-6c0d2a004fd5 is being set with open permissions: ugo+rw Jul 08 14:41:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.89a877d2-2497-4baa-9b52-6c0d2a004fd5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:54 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.89a877d2-2497-4baa-9b52-6c0d2a004fd5 Jul 08 14:41:54 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-36c0d4c5-7a5c-4f0b-8efe-d160b4491393 tempest-VolumeQuotasAdminTestJSON-1450006195 None] Acquiring lock "cinder-a0dcf64a-356c-40cd-b362-d2fb51fada8c-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-36c0d4c5-7a5c-4f0b-8efe-d160b4491393 tempest-VolumeQuotasAdminTestJSON-1450006195 None] Lock "cinder-a0dcf64a-356c-40cd-b362-d2fb51fada8c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-36c0d4c5-7a5c-4f0b-8efe-d160b4491393 tempest-VolumeQuotasAdminTestJSON-1450006195 None] Acquiring lock "cinder-quobyte-a0dcf64a-356c-40cd-b362-d2fb51fada8c" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-36c0d4c5-7a5c-4f0b-8efe-d160b4491393 tempest-VolumeQuotasAdminTestJSON-1450006195 None] Lock "cinder-quobyte-a0dcf64a-356c-40cd-b362-d2fb51fada8c" acquired by "delete_volume" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:54 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dff3e4d-3246-4ddb-9e4c-278afa4c2d2d]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-36c0d4c5-7a5c-4f0b-8efe-d160b4491393 tempest-VolumeQuotasAdminTestJSON-1450006195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a0dcf64a-356c-40cd-b362-d2fb51fada8c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:55 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a0dcf64a-356c-40cd-b362-d2fb51fada8c Jul 08 14:41:55 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:55 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.89a877d2-2497-4baa-9b52-6c0d2a004fd5" returned: 0 in 0.915s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:55 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.info Jul 08 14:41:55 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:56 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-36c0d4c5-7a5c-4f0b-8efe-d160b4491393 tempest-VolumeQuotasAdminTestJSON-1450006195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a0dcf64a-356c-40cd-b362-d2fb51fada8c" returned: 0 in 1.018s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-36c0d4c5-7a5c-4f0b-8efe-d160b4491393 tempest-VolumeQuotasAdminTestJSON-1450006195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a0dcf64a-356c-40cd-b362-d2fb51fada8c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:56 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a0dcf64a-356c-40cd-b362-d2fb51fada8c Jul 08 14:41:56 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:56 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.info" returned: 0 in 0.769s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:56 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.info is being set with open permissions: ugo+rw Jul 08 14:41:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:56 devstack sudo[99550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.info Jul 08 14:41:56 devstack sudo[99550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:56 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-36c0d4c5-7a5c-4f0b-8efe-d160b4491393 tempest-VolumeQuotasAdminTestJSON-1450006195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a0dcf64a-356c-40cd-b362-d2fb51fada8c" returned: 0 in 0.743s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-36c0d4c5-7a5c-4f0b-8efe-d160b4491393 tempest-VolumeQuotasAdminTestJSON-1450006195 None] Lock "cinder-quobyte-a0dcf64a-356c-40cd-b362-d2fb51fada8c" released by "delete_volume" :: held 1.844s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:56 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-36c0d4c5-7a5c-4f0b-8efe-d160b4491393 tempest-VolumeQuotasAdminTestJSON-1450006195 None] Created reservations ['1e32e517-34f3-4fa2-861b-a2e061744932', '253a6b27-e300-43cd-a593-bf80912ed8e3', 'b1c2ac9d-aef8-4e4a-9e09-c59df3480f43', '1b6136ab-d9e7-4590-b232-aaf446082031'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:41:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-36c0d4c5-7a5c-4f0b-8efe-d160b4491393 tempest-VolumeQuotasAdminTestJSON-1450006195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-36c0d4c5-7a5c-4f0b-8efe-d160b4491393 tempest-VolumeQuotasAdminTestJSON-1450006195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-36c0d4c5-7a5c-4f0b-8efe-d160b4491393 tempest-VolumeQuotasAdminTestJSON-1450006195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-36c0d4c5-7a5c-4f0b-8efe-d160b4491393 tempest-VolumeQuotasAdminTestJSON-1450006195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-36c0d4c5-7a5c-4f0b-8efe-d160b4491393 tempest-VolumeQuotasAdminTestJSON-1450006195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-36c0d4c5-7a5c-4f0b-8efe-d160b4491393 tempest-VolumeQuotasAdminTestJSON-1450006195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:57 devstack sudo[99553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:41:57 devstack sudo[99553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:57 devstack sudo[99550]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.info" returned: 0 in 0.877s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Acquiring lock "cinder-quobyte-33b86528-c48d-4b62-adce-52c4ba7512fe" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:41:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Lock "cinder-quobyte-33b86528-c48d-4b62-adce-52c4ba7512fe" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:41:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] snapshot: 89a877d2-2497-4baa-9b52-6c0d2a004fd5, volume: 33b86528-c48d-4b62-adce-52c4ba7512fe, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:41:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:57 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd57dd4-c188-4fbf-be72-6d128c07aa33]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.89a877d2-2497-4baa-9b52-6c0d2a004fd5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:57 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.89a877d2-2497-4baa-9b52-6c0d2a004fd5 Jul 08 14:41:57 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:57 devstack sudo[99553]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-36c0d4c5-7a5c-4f0b-8efe-d160b4491393 tempest-VolumeQuotasAdminTestJSON-1450006195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.979s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:57 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-36c0d4c5-7a5c-4f0b-8efe-d160b4491393 tempest-VolumeQuotasAdminTestJSON-1450006195 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:41:57 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-36c0d4c5-7a5c-4f0b-8efe-d160b4491393 tempest-VolumeQuotasAdminTestJSON-1450006195 None] Deleted volume successfully. Jul 08 14:41:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-36c0d4c5-7a5c-4f0b-8efe-d160b4491393 tempest-VolumeQuotasAdminTestJSON-1450006195 None] Lock "cinder-a0dcf64a-356c-40cd-b362-d2fb51fada8c-delete_volume" released by "delete_volume" :: held 3.167s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:41:58 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.89a877d2-2497-4baa-9b52-6c0d2a004fd5" returned: 0 in 1.078s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bfd9b24-fa57-4304-bd81-f37509d5a028(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:41:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:41:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:41:58 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b475176a-d01d-449d-b4a8-9d206455d355]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:41:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:58 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 Jul 08 14:41:58 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:41:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:41:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:41:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:41:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:41:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:41:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:59 devstack sudo[99569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:41:59 devstack sudo[99569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:41:59 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Jul 08 14:41:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028" returned: 0 in 0.992s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:41:59 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Path /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-33b86528-c48d-4b62-adce-52c4ba7512fe not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:41:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-33b86528-c48d-4b62-adce-52c4ba7512fe {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:41:59 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-33b86528-c48d-4b62-adce-52c4ba7512fe Jul 08 14:41:59 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:00 devstack sudo[99569]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.892s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:42:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:42:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:42:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:42:06 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-33b86528-c48d-4b62-adce-52c4ba7512fe" returned: 0 in 6.860s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:06 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[82063a38-285d-4e44-a6aa-2df38efff226]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:06 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 Jul 08 14:42:06 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:06 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=83,cinder:SELECT=70,cinder:INSERT=25,cinder:DELETE=3 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:42:07 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028" returned: 0 in 1.314s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:07 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Image conversion details: src /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028, size 1024.00 MB, duration 6.86 sec, destination /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-33b86528-c48d-4b62-adce-52c4ba7512fe {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:42:07 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Converted 1024.00 MB image at 149.20 MB/s Jul 08 14:42:07 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-33b86528-c48d-4b62-adce-52c4ba7512fe is being set with open permissions: ugo+rw Jul 08 14:42:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-33b86528-c48d-4b62-adce-52c4ba7512fe {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:07 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-33b86528-c48d-4b62-adce-52c4ba7512fe Jul 08 14:42:07 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:08 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=44,cinder:SELECT=23,cinder:DELETE=6,cinder:INSERT=7 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:42:08 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-33b86528-c48d-4b62-adce-52c4ba7512fe" returned: 0 in 0.851s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Lock "cinder-quobyte-33b86528-c48d-4b62-adce-52c4ba7512fe" released by "_copy_volume_from_snapshot" :: held 11.227s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Acquiring lock "cinder-quobyte-89a877d2-2497-4baa-9b52-6c0d2a004fd5" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:42:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Lock "cinder-quobyte-89a877d2-2497-4baa-9b52-6c0d2a004fd5" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:42:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Deleting offline snapshot 89a877d2-2497-4baa-9b52-6c0d2a004fd5 of volume 3bfd9b24-fa57-4304-bd81-f37509d5a028 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:42:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] snapshot_file for this snap is: volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.89a877d2-2497-4baa-9b52-6c0d2a004fd5 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:42:08 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf54759-e49b-4d46-91b1-0832d9e20edd]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.89a877d2-2497-4baa-9b52-6c0d2a004fd5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:08 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.89a877d2-2497-4baa-9b52-6c0d2a004fd5 Jul 08 14:42:08 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:09 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.89a877d2-2497-4baa-9b52-6c0d2a004fd5" returned: 0 in 1.094s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bfd9b24-fa57-4304-bd81-f37509d5a028(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:42:09 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[213cf0f5-9664-46fb-9668-7d9e394c9731]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:09 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 Jul 08 14:42:09 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:10 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028" returned: 0 in 1.108s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.89a877d2-2497-4baa-9b52-6c0d2a004fd5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:10 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.89a877d2-2497-4baa-9b52-6c0d2a004fd5 Jul 08 14:42:10 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:12 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.89a877d2-2497-4baa-9b52-6c0d2a004fd5" returned: 0 in 1.174s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.89a877d2-2497-4baa-9b52-6c0d2a004fd5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:12 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.89a877d2-2497-4baa-9b52-6c0d2a004fd5 Jul 08 14:42:12 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:12 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028.89a877d2-2497-4baa-9b52-6c0d2a004fd5" returned: 0 in 0.784s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Lock "cinder-quobyte-89a877d2-2497-4baa-9b52-6c0d2a004fd5" released by "_delete_snapshot" :: held 4.303s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.353s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dad74fad-28ba-4402-9259-4b41223d2dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33b86528-c48d-4b62-adce-52c4ba7512fe', 'volume_size': 1, 'source_volid': '3bfd9b24-fa57-4304-bd81-f37509d5a028', 'source_volstatus': 'available'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d50a221e-8725-44b3-8a7e-1927a37a8bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:12 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Volume volume-33b86528-c48d-4b62-adce-52c4ba7512fe (33b86528-c48d-4b62-adce-52c4ba7512fe): created successfully Jul 08 14:42:13 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d50a221e-8725-44b3-8a7e-1927a37a8bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:13 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Flow 'volume_create_manager' (ca375321-f930-43e3-be14-75606f693d87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:13 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2e4ba1b9-54aa-4d93-9a93-8d7f9aaa2aa0 tempest-VolumesGetTest-146683015 None] Created volume successfully. Jul 08 14:42:14 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:42:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Flow 'volume_create_manager' (331e9bce-1e43-47f9-807b-16d56c3985f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c345c03-7035-47f3-95cd-abbe2b827fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c345c03-7035-47f3-95cd-abbe2b827fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:42:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-339577176',display_name='tempest-VolumesGetTest-Volume-1210235674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d077558e-e11a-4bc1-953d-02f590ac2b89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c540366ab0046409c68a194c70c5eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:14Z,use_quota=True,user_id='b9771e9f58cf4fa296a9e34f46a93a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fdd73da-d77d-4515-b50b-165a1704f30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fdd73da-d77d-4515-b50b-165a1704f30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a87f501-230f-46b4-aed8-98ab92cf6222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a87f501-230f-46b4-aed8-98ab92cf6222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd077558e-e11a-4bc1-953d-02f590ac2b89', 'volume_name': 'volume-d077558e-e11a-4bc1-953d-02f590ac2b89', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1950a508-6f02-4a61-93f0-e92b8aec6eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1950a508-6f02-4a61-93f0-e92b8aec6eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4663514-1c06-47be-ae3d-760e95706454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:14 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Volume d077558e-e11a-4bc1-953d-02f590ac2b89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d077558e-e11a-4bc1-953d-02f590ac2b89', 'volume_size': 1} Jul 08 14:42:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:42:14Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-339577176',display_name='tempest-VolumesGetTest-Volume-1210235674',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d077558e-e11a-4bc1-953d-02f590ac2b89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c540366ab0046409c68a194c70c5eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:14Z,use_quota=True,user_id='b9771e9f58cf4fa296a9e34f46a93a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:42:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Creating volume d077558e-e11a-4bc1-953d-02f590ac2b89 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:42:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:42:14 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:42:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d077558e-e11a-4bc1-953d-02f590ac2b89 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:14 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d077558e-e11a-4bc1-953d-02f590ac2b89 1073741824 Jul 08 14:42:14 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:15 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d077558e-e11a-4bc1-953d-02f590ac2b89 1073741824" returned: 0 in 1.046s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d077558e-e11a-4bc1-953d-02f590ac2b89 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:15 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d077558e-e11a-4bc1-953d-02f590ac2b89 Jul 08 14:42:15 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:15 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:42:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Flow 'volume_create_manager' (2055eb1b-1f79-432a-8d3c-ad7c41aff3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43557582-9094-4624-8a7c-787153e6e7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43557582-9094-4624-8a7c-787153e6e7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2133995228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8684fee8-e72a-4f76-9c33-a0963b44e832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c508929fd349b3b3fa2519de89416e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:16Z,use_quota=True,user_id='6b6a73210df744e4805d2ce8497fbac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9780406b-6cfb-4b56-81a3-9e565a509dde),volume_type_id=9780406b-6cfb-4b56-81a3-9e565a509dde)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f157d2e-23db-43d5-8cd9-e17740f3ac0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f157d2e-23db-43d5-8cd9-e17740f3ac0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d7fb5a-f7c2-4d67-ae6c-c288bce3c49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49d7fb5a-f7c2-4d67-ae6c-c288bce3c49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8684fee8-e72a-4f76-9c33-a0963b44e832', 'volume_name': 'volume-8684fee8-e72a-4f76-9c33-a0963b44e832', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92953ffd-9e3e-40a7-b3da-f9a9cad5ac24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92953ffd-9e3e-40a7-b3da-f9a9cad5ac24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c36dc43-283e-45f0-ab6d-02a805271f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:16 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Volume 8684fee8-e72a-4f76-9c33-a0963b44e832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8684fee8-e72a-4f76-9c33-a0963b44e832', 'volume_size': 1} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:16 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d077558e-e11a-4bc1-953d-02f590ac2b89" returned: 0 in 1.002s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.109s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.182s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2133995228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8684fee8-e72a-4f76-9c33-a0963b44e832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c508929fd349b3b3fa2519de89416e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:16Z,use_quota=True,user_id='6b6a73210df744e4805d2ce8497fbac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9780406b-6cfb-4b56-81a3-9e565a509dde),volume_type_id=9780406b-6cfb-4b56-81a3-9e565a509dde)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Creating volume 8684fee8-e72a-4f76-9c33-a0963b44e832 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:42:16 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8684fee8-e72a-4f76-9c33-a0963b44e832 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:16 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8684fee8-e72a-4f76-9c33-a0963b44e832 1073741824 Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4663514-1c06-47be-ae3d-760e95706454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d077558e-e11a-4bc1-953d-02f590ac2b89', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:16 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9bdcd9-c561-4aa1-9a0a-103853cea466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:16 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Volume volume-d077558e-e11a-4bc1-953d-02f590ac2b89 (d077558e-e11a-4bc1-953d-02f590ac2b89): created successfully Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9bdcd9-c561-4aa1-9a0a-103853cea466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Flow 'volume_create_manager' (331e9bce-1e43-47f9-807b-16d56c3985f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:16 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-58048ec6-d7f1-440f-aec5-a0e1f6de2aeb tempest-VolumesGetTest-146683015 None] Created volume successfully. Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Flow 'volume_create_manager' (4f11889f-5878-4938-ac89-dfcab55d32ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36a8d5a-16ce-4929-bac7-fd28af645ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36a8d5a-16ce-4929-bac7-fd28af645ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-746598619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b350800b-e279-41a4-a095-cecad630df11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c508929fd349b3b3fa2519de89416e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:17Z,use_quota=True,user_id='6b6a73210df744e4805d2ce8497fbac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc984af-dabf-4696-a454-a62eee70c9cf),volume_type_id=0cc984af-dabf-4696-a454-a62eee70c9cf)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005aa47d-f068-4a90-867c-e6b5e13fd149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (005aa47d-f068-4a90-867c-e6b5e13fd149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33cab462-e27f-43f1-94ce-3bdf1dfbbc0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33cab462-e27f-43f1-94ce-3bdf1dfbbc0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b350800b-e279-41a4-a095-cecad630df11', 'volume_name': 'volume-b350800b-e279-41a4-a095-cecad630df11', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (092058c2-590a-42a3-9053-35f975c17822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (092058c2-590a-42a3-9053-35f975c17822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca91bb6d-b05d-47de-b5fa-32119fbae6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:16 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Volume b350800b-e279-41a4-a095-cecad630df11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b350800b-e279-41a4-a095-cecad630df11', 'volume_size': 1} Jul 08 14:42:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:17 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:42:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Flow 'volume_create_manager' (73ef759c-b003-467d-8157-ae926076612a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd35fa10-f5d9-48eb-88d7-004114b79a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd35fa10-f5d9-48eb-88d7-004114b79a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1599950869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d53b1a-841b-4e11-ae40-a906ca1cd0d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c508929fd349b3b3fa2519de89416e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:17Z,use_quota=True,user_id='6b6a73210df744e4805d2ce8497fbac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(600725e5-3f91-429b-bc8a-e56cbb69b036),volume_type_id=600725e5-3f91-429b-bc8a-e56cbb69b036)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a785479-aacb-4feb-a702-21b2d20527fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a785479-aacb-4feb-a702-21b2d20527fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a71d0bf-a8d9-48eb-b20c-1a3d5816359e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:17 devstack cinder-volume[87240]: DEBUG cinder.image.glance [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Creating Keystone auth plugin from conf {{(pid=87240) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 14:42:17 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8684fee8-e72a-4f76-9c33-a0963b44e832 1073741824" returned: 0 in 1.332s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ed7695e1-ec6b-491d-80e4-3d3a6d9911b8 tempest-VolumesGetTest-146683015 None] Acquiring lock "cinder-d077558e-e11a-4bc1-953d-02f590ac2b89-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:42:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8684fee8-e72a-4f76-9c33-a0963b44e832 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ed7695e1-ec6b-491d-80e4-3d3a6d9911b8 tempest-VolumesGetTest-146683015 None] Lock "cinder-d077558e-e11a-4bc1-953d-02f590ac2b89-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:42:17 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8684fee8-e72a-4f76-9c33-a0963b44e832 Jul 08 14:42:17 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ed7695e1-ec6b-491d-80e4-3d3a6d9911b8 tempest-VolumesGetTest-146683015 None] Acquiring lock "cinder-quobyte-d077558e-e11a-4bc1-953d-02f590ac2b89" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:42:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ed7695e1-ec6b-491d-80e4-3d3a6d9911b8 tempest-VolumesGetTest-146683015 None] Lock "cinder-quobyte-d077558e-e11a-4bc1-953d-02f590ac2b89" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:42:17 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfde9ab-6b53-44ef-8073-afa9ea190894]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ed7695e1-ec6b-491d-80e4-3d3a6d9911b8 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d077558e-e11a-4bc1-953d-02f590ac2b89 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:17 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d077558e-e11a-4bc1-953d-02f590ac2b89 Jul 08 14:42:17 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a71d0bf-a8d9-48eb-b20c-1a3d5816359e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '70d53b1a-841b-4e11-ae40-a906ca1cd0d4', 'volume_name': 'volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4', 'volume_size': 1, 'image_id': '2f1dc8ff-0532-448a-806f-ec175be3cf36', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f1dc8ff-0532-448a-806f-ec175be3cf36', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--635552419', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '92c508929fd349b3b3fa2519de89416e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f1dc8ff-0532-448a-806f-ec175be3cf36', 'created_at': datetime.datetime(2026, 7, 8, 12, 42, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 42, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f1dc8ff-0532-448a-806f-ec175be3cf36/file', 'properties': {}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de12e88-1416-4eac-bcb8-af21480b4564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8de12e88-1416-4eac-bcb8-af21480b4564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e80ee116-0d36-4d94-9843-988e7ce25779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:18 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Volume 70d53b1a-841b-4e11-ae40-a906ca1cd0d4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4', 'volume_size': 1, 'image_id': '2f1dc8ff-0532-448a-806f-ec175be3cf36', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f1dc8ff-0532-448a-806f-ec175be3cf36', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--635552419', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '92c508929fd349b3b3fa2519de89416e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f1dc8ff-0532-448a-806f-ec175be3cf36', 'created_at': datetime.datetime(2026, 7, 8, 12, 42, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 42, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f1dc8ff-0532-448a-806f-ec175be3cf36/file', 'properties': {}}, 'image_service': } Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Trying to clone 70d53b1a-841b-4e11-ae40-a906ca1cd0d4 from image 2f1dc8ff-0532-448a-806f-ec175be3cf36 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2f1dc8ff-0532-448a-806f-ec175be3cf36', 'metadata': {}}]). {{(pid=87240) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Flow 'volume_create_manager' (83d9e475-bac9-4ce5-8c9b-c5998db971ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd3c974-b905-4333-97b0-9658c2b7368e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccd3c974-b905-4333-97b0-9658c2b7368e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1503205904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2744235e-5618-4609-92cf-75aeee4ac079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0539cb5ca9f14765b23d0d8c4431251d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:18Z,use_quota=True,user_id='fa7e8d6290a64550949ae62ccd56efba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ab8003-952e-44e0-badd-0dc5bfb67c93),volume_type_id=b1ab8003-952e-44e0-badd-0dc5bfb67c93)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46b1e84-48aa-42fb-87bb-7422b3c2fdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46b1e84-48aa-42fb-87bb-7422b3c2fdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff580fcb-2e0b-4060-808a-fb21b2c54434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff580fcb-2e0b-4060-808a-fb21b2c54434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2744235e-5618-4609-92cf-75aeee4ac079', 'volume_name': 'volume-2744235e-5618-4609-92cf-75aeee4ac079', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72be0973-4065-474f-8faf-6f9b30e484bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72be0973-4065-474f-8faf-6f9b30e484bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f383fc-afc3-43b6-b7c4-23372770408e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:18 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Volume 2744235e-5618-4609-92cf-75aeee4ac079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2744235e-5618-4609-92cf-75aeee4ac079', 'volume_size': 1} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:18 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8684fee8-e72a-4f76-9c33-a0963b44e832" returned: 0 in 1.015s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] <== create_volume: return (2423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.427s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.803s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-746598619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b350800b-e279-41a4-a095-cecad630df11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c508929fd349b3b3fa2519de89416e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:17Z,use_quota=True,user_id='6b6a73210df744e4805d2ce8497fbac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cc984af-dabf-4696-a454-a62eee70c9cf),volume_type_id=0cc984af-dabf-4696-a454-a62eee70c9cf)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Creating volume b350800b-e279-41a4-a095-cecad630df11 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:42:18 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b350800b-e279-41a4-a095-cecad630df11 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:18 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b350800b-e279-41a4-a095-cecad630df11 1073741824 Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c36dc43-283e-45f0-ab6d-02a805271f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8684fee8-e72a-4f76-9c33-a0963b44e832', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:18 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86afb018-570a-4a9a-9aea-9522b5b5bc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:18 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Volume volume-8684fee8-e72a-4f76-9c33-a0963b44e832 (8684fee8-e72a-4f76-9c33-a0963b44e832): created successfully Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86afb018-570a-4a9a-9aea-9522b5b5bc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Flow 'volume_create_manager' (2055eb1b-1f79-432a-8d3c-ad7c41aff3d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:18 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0cf26a8c-bf24-4a03-98a5-3a05ecb177ab tempest-TestInstancesWithCinderVolumes-760645170 None] Created volume successfully. Jul 08 14:42:18 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ed7695e1-ec6b-491d-80e4-3d3a6d9911b8 tempest-VolumesGetTest-146683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d077558e-e11a-4bc1-953d-02f590ac2b89" returned: 0 in 1.077s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ed7695e1-ec6b-491d-80e4-3d3a6d9911b8 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d077558e-e11a-4bc1-953d-02f590ac2b89 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:18 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d077558e-e11a-4bc1-953d-02f590ac2b89 Jul 08 14:42:18 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:19 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ed7695e1-ec6b-491d-80e4-3d3a6d9911b8 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d077558e-e11a-4bc1-953d-02f590ac2b89" returned: 0 in 0.792s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ed7695e1-ec6b-491d-80e4-3d3a6d9911b8 tempest-VolumesGetTest-146683015 None] Lock "cinder-quobyte-d077558e-e11a-4bc1-953d-02f590ac2b89" released by "delete_volume" :: held 1.927s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:19 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b350800b-e279-41a4-a095-cecad630df11 1073741824" returned: 0 in 1.041s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:19 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-ed7695e1-ec6b-491d-80e4-3d3a6d9911b8 tempest-VolumesGetTest-146683015 None] Created reservations ['5610c158-21bb-499a-a2f9-b53ca40cfa1b', '0d5859b6-7a39-41f1-955e-34bc94b5dd8f', '9ca249d6-b1c6-49eb-a700-288c8ce2b46f', '84257702-cae7-4381-8b48-79ae7aa00c27'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:42:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b350800b-e279-41a4-a095-cecad630df11 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:19 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b350800b-e279-41a4-a095-cecad630df11 Jul 08 14:42:19 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ed7695e1-ec6b-491d-80e4-3d3a6d9911b8 tempest-VolumesGetTest-146683015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ed7695e1-ec6b-491d-80e4-3d3a6d9911b8 tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ed7695e1-ec6b-491d-80e4-3d3a6d9911b8 tempest-VolumesGetTest-146683015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ed7695e1-ec6b-491d-80e4-3d3a6d9911b8 tempest-VolumesGetTest-146683015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ed7695e1-ec6b-491d-80e4-3d3a6d9911b8 tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ed7695e1-ec6b-491d-80e4-3d3a6d9911b8 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:19 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:42:19 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-67e16358-fe15-4603-a25d-16db2ebf0591 tempest-VolumesGetTest-146683015 None] Acquiring lock "cinder-33b86528-c48d-4b62-adce-52c4ba7512fe-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-67e16358-fe15-4603-a25d-16db2ebf0591 tempest-VolumesGetTest-146683015 None] Lock "cinder-33b86528-c48d-4b62-adce-52c4ba7512fe-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-67e16358-fe15-4603-a25d-16db2ebf0591 tempest-VolumesGetTest-146683015 None] Acquiring lock "cinder-quobyte-33b86528-c48d-4b62-adce-52c4ba7512fe" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-67e16358-fe15-4603-a25d-16db2ebf0591 tempest-VolumesGetTest-146683015 None] Lock "cinder-quobyte-33b86528-c48d-4b62-adce-52c4ba7512fe" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2a8ee9-1a35-487c-bc27-7969cf5c0c1b]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-67e16358-fe15-4603-a25d-16db2ebf0591 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-33b86528-c48d-4b62-adce-52c4ba7512fe {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:20 devstack sudo[99651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-33b86528-c48d-4b62-adce-52c4ba7512fe Jul 08 14:42:20 devstack sudo[99651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:20 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ed7695e1-ec6b-491d-80e4-3d3a6d9911b8 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.831s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-ed7695e1-ec6b-491d-80e4-3d3a6d9911b8 tempest-VolumesGetTest-146683015 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:42:20 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:20 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ed7695e1-ec6b-491d-80e4-3d3a6d9911b8 tempest-VolumesGetTest-146683015 None] Deleted volume successfully. Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b350800b-e279-41a4-a095-cecad630df11" returned: 0 in 0.935s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] <== create_volume: return (2041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.301s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:42:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1503205904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2744235e-5618-4609-92cf-75aeee4ac079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0539cb5ca9f14765b23d0d8c4431251d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:18Z,use_quota=True,user_id='fa7e8d6290a64550949ae62ccd56efba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1ab8003-952e-44e0-badd-0dc5bfb67c93),volume_type_id=b1ab8003-952e-44e0-badd-0dc5bfb67c93)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Creating volume 2744235e-5618-4609-92cf-75aeee4ac079 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:42:20 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2744235e-5618-4609-92cf-75aeee4ac079 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:20 devstack sudo[99655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2744235e-5618-4609-92cf-75aeee4ac079 1073741824 Jul 08 14:42:20 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca91bb6d-b05d-47de-b5fa-32119fbae6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b350800b-e279-41a4-a095-cecad630df11', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd9143d-0249-467e-ba37-92002c628bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ed7695e1-ec6b-491d-80e4-3d3a6d9911b8 tempest-VolumesGetTest-146683015 None] Lock "cinder-d077558e-e11a-4bc1-953d-02f590ac2b89-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:20 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Volume volume-b350800b-e279-41a4-a095-cecad630df11 (b350800b-e279-41a4-a095-cecad630df11): created successfully Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd9143d-0249-467e-ba37-92002c628bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Flow 'volume_create_manager' (4f11889f-5878-4938-ac89-dfcab55d32ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:20 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-34009e81-04cf-4c5e-92c2-b89dbd2baf5e tempest-TestInstancesWithCinderVolumes-760645170 None] Created volume successfully. Jul 08 14:42:21 devstack sudo[99651]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-67e16358-fe15-4603-a25d-16db2ebf0591 tempest-VolumesGetTest-146683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-33b86528-c48d-4b62-adce-52c4ba7512fe" returned: 0 in 0.999s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-67e16358-fe15-4603-a25d-16db2ebf0591 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-33b86528-c48d-4b62-adce-52c4ba7512fe {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:21 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-33b86528-c48d-4b62-adce-52c4ba7512fe Jul 08 14:42:21 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:21 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2744235e-5618-4609-92cf-75aeee4ac079 1073741824" returned: 0 in 0.959s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2744235e-5618-4609-92cf-75aeee4ac079 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:21 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2744235e-5618-4609-92cf-75aeee4ac079 Jul 08 14:42:21 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:21 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-67e16358-fe15-4603-a25d-16db2ebf0591 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-33b86528-c48d-4b62-adce-52c4ba7512fe" returned: 0 in 0.680s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-67e16358-fe15-4603-a25d-16db2ebf0591 tempest-VolumesGetTest-146683015 None] Lock "cinder-quobyte-33b86528-c48d-4b62-adce-52c4ba7512fe" released by "delete_volume" :: held 1.738s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:21 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-67e16358-fe15-4603-a25d-16db2ebf0591 tempest-VolumesGetTest-146683015 None] Created reservations ['57ca46ae-ce23-4e30-ad45-52ef9ae5a136', 'e1346e98-51f1-495d-982d-475e777f1c3c', '01af5555-93f0-4b10-ba8b-b393e30655b5', '348e870a-cd4a-4845-aeeb-89a6c42dbd50'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:42:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-67e16358-fe15-4603-a25d-16db2ebf0591 tempest-VolumesGetTest-146683015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-67e16358-fe15-4603-a25d-16db2ebf0591 tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:21 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-67e16358-fe15-4603-a25d-16db2ebf0591 tempest-VolumesGetTest-146683015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:21 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-67e16358-fe15-4603-a25d-16db2ebf0591 tempest-VolumesGetTest-146683015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-67e16358-fe15-4603-a25d-16db2ebf0591 tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-67e16358-fe15-4603-a25d-16db2ebf0591 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:22 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:42:22 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-41b53a98-78fd-450a-a502-5adb16eae01e tempest-VolumesGetTest-146683015 None] Acquiring lock "cinder-3bfd9b24-fa57-4304-bd81-f37509d5a028-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:42:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-41b53a98-78fd-450a-a502-5adb16eae01e tempest-VolumesGetTest-146683015 None] Lock "cinder-3bfd9b24-fa57-4304-bd81-f37509d5a028-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:42:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-41b53a98-78fd-450a-a502-5adb16eae01e tempest-VolumesGetTest-146683015 None] Acquiring lock "cinder-quobyte-3bfd9b24-fa57-4304-bd81-f37509d5a028" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:42:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-41b53a98-78fd-450a-a502-5adb16eae01e tempest-VolumesGetTest-146683015 None] Lock "cinder-quobyte-3bfd9b24-fa57-4304-bd81-f37509d5a028" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:42:22 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac0e25f-198c-4ad1-866b-8dddae5580c9]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-41b53a98-78fd-450a-a502-5adb16eae01e tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:22 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2744235e-5618-4609-92cf-75aeee4ac079" returned: 0 in 0.820s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] <== create_volume: return (1828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:42:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50f383fc-afc3-43b6-b7c4-23372770408e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2744235e-5618-4609-92cf-75aeee4ac079', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fcb3ae3-94af-4ce2-8140-e0c53029206c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:22 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Volume volume-2744235e-5618-4609-92cf-75aeee4ac079 (2744235e-5618-4609-92cf-75aeee4ac079): created successfully Jul 08 14:42:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fcb3ae3-94af-4ce2-8140-e0c53029206c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Flow 'volume_create_manager' (83d9e475-bac9-4ce5-8c9b-c5998db971ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:22 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c7668b82-cf11-45c0-8dd3-1eecfe718519 tempest-VolumeTypesAccessTest-1529764149 None] Created volume successfully. Jul 08 14:42:22 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 Jul 08 14:42:22 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:22 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2f1dc8ff-0532-448a-806f-ec175be3cf36_zjc6vy48devstack@QuobyteHD, size 20.69 MB, duration 4.52 sec {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 14:42:22 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Image download 20.69 MB at 4.58 MB/s Jul 08 14:42:22 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4240a5f6-cfcc-43ce-89ad-4ab0dca291d9]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1dc8ff-0532-448a-806f-ec175be3cf36_zjc6vy48devstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:22 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-67e16358-fe15-4603-a25d-16db2ebf0591 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.852s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:22 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-67e16358-fe15-4603-a25d-16db2ebf0591 tempest-VolumesGetTest-146683015 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:42:22 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-67e16358-fe15-4603-a25d-16db2ebf0591 tempest-VolumesGetTest-146683015 None] Deleted volume successfully. Jul 08 14:42:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-67e16358-fe15-4603-a25d-16db2ebf0591 tempest-VolumesGetTest-146683015 None] Lock "cinder-33b86528-c48d-4b62-adce-52c4ba7512fe-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:22 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1dc8ff-0532-448a-806f-ec175be3cf36_zjc6vy48devstack@QuobyteHD Jul 08 14:42:22 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:23 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-41b53a98-78fd-450a-a502-5adb16eae01e tempest-VolumesGetTest-146683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028" returned: 0 in 0.960s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-41b53a98-78fd-450a-a502-5adb16eae01e tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:23 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028 Jul 08 14:42:23 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:23 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1dc8ff-0532-448a-806f-ec175be3cf36_zjc6vy48devstack@QuobyteHD" returned: 0 in 0.784s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:23 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Temporary image 2f1dc8ff-0532-448a-806f-ec175be3cf36 is fetched for user 6b6a73210df744e4805d2ce8497fbac5. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 14:42:23 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[77553087-7d6c-4821-bf78-b37207c0ff02]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1dc8ff-0532-448a-806f-ec175be3cf36_zjc6vy48devstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d0984bff-7463-4dec-98c1-857a435f835f tempest-VolumeTypesAccessTest-1529764149 None] Acquiring lock "cinder-2744235e-5618-4609-92cf-75aeee4ac079-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:42:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d0984bff-7463-4dec-98c1-857a435f835f tempest-VolumeTypesAccessTest-1529764149 None] Lock "cinder-2744235e-5618-4609-92cf-75aeee4ac079-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:42:23 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1dc8ff-0532-448a-806f-ec175be3cf36_zjc6vy48devstack@QuobyteHD Jul 08 14:42:23 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d0984bff-7463-4dec-98c1-857a435f835f tempest-VolumeTypesAccessTest-1529764149 None] Acquiring lock "cinder-quobyte-2744235e-5618-4609-92cf-75aeee4ac079" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:42:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d0984bff-7463-4dec-98c1-857a435f835f tempest-VolumeTypesAccessTest-1529764149 None] Lock "cinder-quobyte-2744235e-5618-4609-92cf-75aeee4ac079" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:42:23 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7b14f4-77f4-4838-9024-a1c5997cbfd8]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0984bff-7463-4dec-98c1-857a435f835f tempest-VolumeTypesAccessTest-1529764149 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2744235e-5618-4609-92cf-75aeee4ac079 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:24 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2744235e-5618-4609-92cf-75aeee4ac079 Jul 08 14:42:24 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:24 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-41b53a98-78fd-450a-a502-5adb16eae01e tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3bfd9b24-fa57-4304-bd81-f37509d5a028" returned: 0 in 0.762s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-41b53a98-78fd-450a-a502-5adb16eae01e tempest-VolumesGetTest-146683015 None] Lock "cinder-quobyte-3bfd9b24-fa57-4304-bd81-f37509d5a028" released by "delete_volume" :: held 1.809s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:24 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-41b53a98-78fd-450a-a502-5adb16eae01e tempest-VolumesGetTest-146683015 None] Created reservations ['f2daa923-6882-40e1-886f-4ffc3261bb90', 'ee4ffc1d-4108-4186-8bca-47fbaf034907', 'd72f5c2c-6975-411d-a349-f19f943e81be', '106b7740-7669-4543-b151-f60c8572743b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:42:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-41b53a98-78fd-450a-a502-5adb16eae01e tempest-VolumesGetTest-146683015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-41b53a98-78fd-450a-a502-5adb16eae01e tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-41b53a98-78fd-450a-a502-5adb16eae01e tempest-VolumesGetTest-146683015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-41b53a98-78fd-450a-a502-5adb16eae01e tempest-VolumesGetTest-146683015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-41b53a98-78fd-450a-a502-5adb16eae01e tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-41b53a98-78fd-450a-a502-5adb16eae01e tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:24 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:42:24 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:24 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1dc8ff-0532-448a-806f-ec175be3cf36_zjc6vy48devstack@QuobyteHD" returned: 0 in 0.818s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1599950869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70d53b1a-841b-4e11-ae40-a906ca1cd0d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c508929fd349b3b3fa2519de89416e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:17Z,use_quota=True,user_id='6b6a73210df744e4805d2ce8497fbac5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(600725e5-3f91-429b-bc8a-e56cbb69b036),volume_type_id=600725e5-3f91-429b-bc8a-e56cbb69b036)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:42:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Creating volume 70d53b1a-841b-4e11-ae40-a906ca1cd0d4 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:42:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:42:24 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:42:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:24 devstack sudo[99696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 1073741824 Jul 08 14:42:24 devstack sudo[99696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:24 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0984bff-7463-4dec-98c1-857a435f835f tempest-VolumeTypesAccessTest-1529764149 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2744235e-5618-4609-92cf-75aeee4ac079" returned: 0 in 0.981s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0984bff-7463-4dec-98c1-857a435f835f tempest-VolumeTypesAccessTest-1529764149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2744235e-5618-4609-92cf-75aeee4ac079 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:24 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2744235e-5618-4609-92cf-75aeee4ac079 Jul 08 14:42:24 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:25 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-41b53a98-78fd-450a-a502-5adb16eae01e tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.886s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:25 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-41b53a98-78fd-450a-a502-5adb16eae01e tempest-VolumesGetTest-146683015 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:42:25 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-41b53a98-78fd-450a-a502-5adb16eae01e tempest-VolumesGetTest-146683015 None] Deleted volume successfully. Jul 08 14:42:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-41b53a98-78fd-450a-a502-5adb16eae01e tempest-VolumesGetTest-146683015 None] Lock "cinder-3bfd9b24-fa57-4304-bd81-f37509d5a028-delete_volume" released by "delete_volume" :: held 3.019s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:25 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:42:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Flow 'volume_create_manager' (28f886c3-5d0c-4d5a-918c-fddded343a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c93d9b5-6a12-4c00-952c-9dfa5b2185de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c93d9b5-6a12-4c00-952c-9dfa5b2185de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1782467157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17714485-5603-41b4-8a6d-ee113f9d6f6c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3c540366ab0046409c68a194c70c5eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:26Z,use_quota=True,user_id='b9771e9f58cf4fa296a9e34f46a93a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98dacb7e-3753-4dcd-8e4d-021848c6eef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98dacb7e-3753-4dcd-8e4d-021848c6eef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d30023b-ff67-48ad-8453-50f384699085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:25 devstack cinder-volume[87240]: DEBUG cinder.image.glance [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Creating Keystone auth plugin from conf {{(pid=87240) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 14:42:25 devstack sudo[99696]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 1073741824" returned: 0 in 1.144s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:25 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 Jul 08 14:42:25 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:25 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0984bff-7463-4dec-98c1-857a435f835f tempest-VolumeTypesAccessTest-1529764149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2744235e-5618-4609-92cf-75aeee4ac079" returned: 0 in 0.907s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d0984bff-7463-4dec-98c1-857a435f835f tempest-VolumeTypesAccessTest-1529764149 None] Lock "cinder-quobyte-2744235e-5618-4609-92cf-75aeee4ac079" released by "delete_volume" :: held 1.945s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:25 devstack cinder-volume[87240]: WARNING cinder.quota [None req-d0984bff-7463-4dec-98c1-857a435f835f tempest-VolumeTypesAccessTest-1529764149 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-946720179 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-946720179, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:42:25 devstack cinder-volume[87240]: WARNING cinder.quota [None req-d0984bff-7463-4dec-98c1-857a435f835f tempest-VolumeTypesAccessTest-1529764149 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-946720179 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-946720179, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:42:25 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-d0984bff-7463-4dec-98c1-857a435f835f tempest-VolumeTypesAccessTest-1529764149 None] Created reservations ['ce96307a-c103-472e-8271-0bacc053df8e', '0f217518-00e8-40ba-a496-278771af3cd0', '7815d9b7-b006-41a5-aea8-5f9f61d08658', 'e923fa4f-9873-4f11-899e-c7ae51972e49'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:42:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d30023b-ff67-48ad-8453-50f384699085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '17714485-5603-41b4-8a6d-ee113f9d6f6c', 'volume_name': 'volume-17714485-5603-41b4-8a6d-ee113f9d6f6c', 'volume_size': 1, 'image_id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f84c09b9fe464edfa51b7a3d44e3b143', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea13920f-37b1-4264-841d-a1841ff19591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea13920f-37b1-4264-841d-a1841ff19591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b047e5-de06-4f68-87b2-18507f1165ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:26 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Volume 17714485-5603-41b4-8a6d-ee113f9d6f6c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-17714485-5603-41b4-8a6d-ee113f9d6f6c', 'volume_size': 1, 'image_id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f84c09b9fe464edfa51b7a3d44e3b143', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 14:42:26 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Trying to clone 17714485-5603-41b4-8a6d-ee113f9d6f6c from image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}]). {{(pid=87240) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 14:42:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d0984bff-7463-4dec-98c1-857a435f835f tempest-VolumeTypesAccessTest-1529764149 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d0984bff-7463-4dec-98c1-857a435f835f tempest-VolumeTypesAccessTest-1529764149 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d0984bff-7463-4dec-98c1-857a435f835f tempest-VolumeTypesAccessTest-1529764149 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d0984bff-7463-4dec-98c1-857a435f835f tempest-VolumeTypesAccessTest-1529764149 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d0984bff-7463-4dec-98c1-857a435f835f tempest-VolumeTypesAccessTest-1529764149 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0984bff-7463-4dec-98c1-857a435f835f tempest-VolumeTypesAccessTest-1529764149 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:26 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:42:26 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:26 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_pq9rc7bjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 14:42:26 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Image download 20.69 MB at 20.69 MB/s Jul 08 14:42:26 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8c21a5-e262-497a-be4e-4435bb59d242]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_pq9rc7bjdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:26 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4" returned: 0 in 0.981s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] <== create_volume: return (2203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:42:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.206s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:26 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Attempting download of 2f1dc8ff-0532-448a-806f-ec175be3cf36 ((None, [{'url': 'file:///opt/stack/data/glance/images/2f1dc8ff-0532-448a-806f-ec175be3cf36', 'metadata': {}}])) to volume 70d53b1a-841b-4e11-ae40-a906ca1cd0d4. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 14:42:26 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d3f758-c46d-4686-a5d5-b49376ffcde9]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f1dc8ff-0532-448a-806f-ec175be3cf36_ipg17rp7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:26 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_pq9rc7bjdevstack@QuobyteHD Jul 08 14:42:26 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:26 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f1dc8ff-0532-448a-806f-ec175be3cf36_ipg17rp7 Jul 08 14:42:26 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:27 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d0984bff-7463-4dec-98c1-857a435f835f tempest-VolumeTypesAccessTest-1529764149 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.931s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:27 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-d0984bff-7463-4dec-98c1-857a435f835f tempest-VolumeTypesAccessTest-1529764149 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:42:27 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d0984bff-7463-4dec-98c1-857a435f835f tempest-VolumeTypesAccessTest-1529764149 None] Deleted volume successfully. Jul 08 14:42:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d0984bff-7463-4dec-98c1-857a435f835f tempest-VolumeTypesAccessTest-1529764149 None] Lock "cinder-2744235e-5618-4609-92cf-75aeee4ac079-delete_volume" released by "delete_volume" :: held 3.246s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:27 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_pq9rc7bjdevstack@QuobyteHD" returned: 0 in 0.948s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:27 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Temporary image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 is fetched for user b9771e9f58cf4fa296a9e34f46a93a83. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 14:42:27 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:27 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bc2c63-c2d6-4c67-8553-ec7dbfdd3a46]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_pq9rc7bjdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f1dc8ff-0532-448a-806f-ec175be3cf36_ipg17rp7" returned: 0 in 0.923s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f1dc8ff-0532-448a-806f-ec175be3cf36_ipg17rp7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:27 devstack sudo[99726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_pq9rc7bjdevstack@QuobyteHD Jul 08 14:42:27 devstack sudo[99726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:27 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f1dc8ff-0532-448a-806f-ec175be3cf36_ipg17rp7 Jul 08 14:42:27 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:28 devstack sudo[99726]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_pq9rc7bjdevstack@QuobyteHD" returned: 0 in 0.828s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:42:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1782467157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17714485-5603-41b4-8a6d-ee113f9d6f6c,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3c540366ab0046409c68a194c70c5eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:26Z,use_quota=True,user_id='b9771e9f58cf4fa296a9e34f46a93a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:42:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Creating volume 17714485-5603-41b4-8a6d-ee113f9d6f6c {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:42:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:42:28 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:42:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:28 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f1dc8ff-0532-448a-806f-ec175be3cf36_ipg17rp7" returned: 1 in 0.841s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f1dc8ff-0532-448a-806f-ec175be3cf36_ipg17rp7' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:42:28 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[106bb161-a9d6-40c8-a4c8-50f91f1bda9b]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1dc8ff-0532-448a-806f-ec175be3cf36_zjc6vy48devstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:28 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c 1073741824 Jul 08 14:42:28 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:28 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1dc8ff-0532-448a-806f-ec175be3cf36_zjc6vy48devstack@QuobyteHD Jul 08 14:42:28 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:29 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f1dc8ff-0532-448a-806f-ec175be3cf36_zjc6vy48devstack@QuobyteHD" returned: 0 in 0.848s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:29 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] 2f1dc8ff-0532-448a-806f-ec175be3cf36 was qcow2, converting to raw {{(pid=87240) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 14:42:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f1dc8ff-0532-448a-806f-ec175be3cf36_zjc6vy48devstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:29 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f1dc8ff-0532-448a-806f-ec175be3cf36_zjc6vy48devstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 Jul 08 14:42:29 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:29 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c 1073741824" returned: 0 in 1.081s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:29 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c Jul 08 14:42:29 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:30 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c" returned: 0 in 0.751s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:42:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:30 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Attempting download of 8a72c3c4-bdc8-4198-ab53-8c7f86124915 ((None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}])) to volume 17714485-5603-41b4-8a6d-ee113f9d6f6c. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 14:42:30 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c365e36e-01c0-4a5c-9576-34229e9b8d13]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_5h4gg_n_ {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:30 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_5h4gg_n_ Jul 08 14:42:30 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:31 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_5h4gg_n_" returned: 0 in 1.048s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_5h4gg_n_ {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:31 devstack sudo[99765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_5h4gg_n_ Jul 08 14:42:31 devstack sudo[99765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:32 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f1dc8ff-0532-448a-806f-ec175be3cf36_zjc6vy48devstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4" returned: 0 in 2.570s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:32 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2f1dc8ff-0532-448a-806f-ec175be3cf36_zjc6vy48devstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:42:32 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Converted 112.00 MB image at 43.56 MB/s Jul 08 14:42:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:32 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 1G Jul 08 14:42:32 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:32 devstack sudo[99765]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_5h4gg_n_" returned: 1 in 0.914s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_5h4gg_n_' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:42:32 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c4c72f-693c-4341-a023-e19b864d3f28]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_pq9rc7bjdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:32 devstack sudo[99771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_pq9rc7bjdevstack@QuobyteHD Jul 08 14:42:32 devstack sudo[99771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:32 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 1G" returned: 0 in 0.775s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:32 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26e7535-ab78-4f97-b853-14e847908259]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:32 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 Jul 08 14:42:32 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:33 devstack sudo[99771]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_pq9rc7bjdevstack@QuobyteHD" returned: 0 in 0.863s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:33 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] 8a72c3c4-bdc8-4198-ab53-8c7f86124915 was qcow2, converting to raw {{(pid=87240) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 14:42:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_pq9rc7bjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:33 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_pq9rc7bjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c Jul 08 14:42:33 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:33 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4" returned: 0 in 0.938s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:33 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 Jul 08 14:42:33 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:34 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4" returned: 1 in 1.016s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:42:34 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Downloaded image 2f1dc8ff-0532-448a-806f-ec175be3cf36 ((None, [{'url': 'file:///opt/stack/data/glance/images/2f1dc8ff-0532-448a-806f-ec175be3cf36', 'metadata': {}}])) to volume 70d53b1a-841b-4e11-ae40-a906ca1cd0d4 successfully. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 14:42:34 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Temporary image 2f1dc8ff-0532-448a-806f-ec175be3cf36 for user 6b6a73210df744e4805d2ce8497fbac5 is deleted. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 14:42:34 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Marking volume 70d53b1a-841b-4e11-ae40-a906ca1cd0d4 as bootable. {{(pid=87240) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 14:42:34 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Copying metadata from image 2f1dc8ff-0532-448a-806f-ec175be3cf36 to 70d53b1a-841b-4e11-ae40-a906ca1cd0d4. {{(pid=87240) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 14:42:34 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Creating volume glance metadata for volume 70d53b1a-841b-4e11-ae40-a906ca1cd0d4 backed by image 2f1dc8ff-0532-448a-806f-ec175be3cf36 with: {'image_id': '2f1dc8ff-0532-448a-806f-ec175be3cf36', 'image_name': 'tempest-scenario-img--635552419', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87240) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 14:42:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e80ee116-0d36-4d94-9843-988e7ce25779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4', 'volume_size': 1, 'image_id': '2f1dc8ff-0532-448a-806f-ec175be3cf36', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f1dc8ff-0532-448a-806f-ec175be3cf36', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--635552419', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '92c508929fd349b3b3fa2519de89416e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f1dc8ff-0532-448a-806f-ec175be3cf36', 'created_at': datetime.datetime(2026, 7, 8, 12, 42, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 42, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f1dc8ff-0532-448a-806f-ec175be3cf36/file', 'properties': {}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176cf9f2-2d98-4ab2-ae26-aebf6043e1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:34 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Volume volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 (70d53b1a-841b-4e11-ae40-a906ca1cd0d4): created successfully Jul 08 14:42:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176cf9f2-2d98-4ab2-ae26-aebf6043e1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Flow 'volume_create_manager' (73ef759c-b003-467d-8157-ae926076612a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:34 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fbb3ce82-7390-4e2e-9da2-d4c57985dc2a tempest-TestInstancesWithCinderVolumes-760645170 None] Created volume successfully. Jul 08 14:42:35 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_pq9rc7bjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c" returned: 0 in 2.384s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:35 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_pq9rc7bjdevstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:42:35 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Converted 112.00 MB image at 46.95 MB/s Jul 08 14:42:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:35 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c 1G Jul 08 14:42:35 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:36 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c 1G" returned: 0 in 0.913s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:36 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[db694a3b-1a80-42d1-b2e8-eb50356e1d57]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:36 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c Jul 08 14:42:36 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:37 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c" returned: 0 in 0.998s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:37 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c Jul 08 14:42:37 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:38 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c" returned: 1 in 1.089s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:42:38 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Downloaded image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 ((None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}])) to volume 17714485-5603-41b4-8a6d-ee113f9d6f6c successfully. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 14:42:38 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Temporary image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 for user b9771e9f58cf4fa296a9e34f46a93a83 is deleted. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 14:42:38 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Marking volume 17714485-5603-41b4-8a6d-ee113f9d6f6c as bootable. {{(pid=87240) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 14:42:38 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Copying metadata from image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 to 17714485-5603-41b4-8a6d-ee113f9d6f6c. {{(pid=87240) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 14:42:38 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Creating volume glance metadata for volume 17714485-5603-41b4-8a6d-ee113f9d6f6c backed by image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87240) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 14:42:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b047e5-de06-4f68-87b2-18507f1165ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17714485-5603-41b4-8a6d-ee113f9d6f6c', 'volume_size': 1, 'image_id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f84c09b9fe464edfa51b7a3d44e3b143', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e16fe2-cb8a-4c22-a8cc-64bbfef27750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:38 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Volume volume-17714485-5603-41b4-8a6d-ee113f9d6f6c (17714485-5603-41b4-8a6d-ee113f9d6f6c): created successfully Jul 08 14:42:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e16fe2-cb8a-4c22-a8cc-64bbfef27750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:38 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Flow 'volume_create_manager' (28f886c3-5d0c-4d5a-918c-fddded343a8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:39 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8f91883f-f669-4472-bc1a-84832007abee tempest-VolumesGetTest-146683015 None] Created volume successfully. Jul 08 14:42:40 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:42:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Flow 'volume_create_manager' (b8564318-a5ac-4c34-86d3-8be586b3d310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca897eb-d447-431a-a6dd-7c3bb782e1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca897eb-d447-431a-a6dd-7c3bb782e1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:42:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-186234793',display_name='tempest-VolumesGetTest-Volume-193919406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0859d624-80d2-4c72-9ae1-0ff1727e6652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c540366ab0046409c68a194c70c5eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:40Z,use_quota=True,user_id='b9771e9f58cf4fa296a9e34f46a93a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e0c5dbd-500c-488a-807e-2da95b923e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e0c5dbd-500c-488a-807e-2da95b923e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500768df-482d-490c-96cc-f54a61c9565f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (500768df-482d-490c-96cc-f54a61c9565f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0859d624-80d2-4c72-9ae1-0ff1727e6652', 'volume_name': 'volume-0859d624-80d2-4c72-9ae1-0ff1727e6652', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f862a37c-d8bf-4f19-9ecb-a02b2e529d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f862a37c-d8bf-4f19-9ecb-a02b2e529d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b619e702-dd8c-4a52-94a5-633be275392c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:40 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Volume 0859d624-80d2-4c72-9ae1-0ff1727e6652: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0859d624-80d2-4c72-9ae1-0ff1727e6652', 'volume_size': 1} Jul 08 14:42:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:42:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-186234793',display_name='tempest-VolumesGetTest-Volume-193919406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0859d624-80d2-4c72-9ae1-0ff1727e6652,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c540366ab0046409c68a194c70c5eea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:40Z,use_quota=True,user_id='b9771e9f58cf4fa296a9e34f46a93a83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:42:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Creating volume 0859d624-80d2-4c72-9ae1-0ff1727e6652 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:42:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:42:40 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:42:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0859d624-80d2-4c72-9ae1-0ff1727e6652 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:40 devstack sudo[99813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0859d624-80d2-4c72-9ae1-0ff1727e6652 1073741824 Jul 08 14:42:40 devstack sudo[99813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:41 devstack sudo[99813]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0859d624-80d2-4c72-9ae1-0ff1727e6652 1073741824" returned: 0 in 0.934s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0859d624-80d2-4c72-9ae1-0ff1727e6652 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:41 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0859d624-80d2-4c72-9ae1-0ff1727e6652 Jul 08 14:42:41 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:41 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:42:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Flow 'volume_create_manager' (346075b4-84f3-4df2-a285-a6eed9d85b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc2cf1d-696f-446f-8c55-f87b00ed1dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc2cf1d-696f-446f-8c55-f87b00ed1dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1511864593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=025ea195-080a-4126-a1b1-05a0553afdd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd1454515f584d7fafb18e38d2198294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:42Z,use_quota=True,user_id='289f5df89d494a9e8b49847fd7c8fe66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba92714f-4d7e-479c-8336-9c91b9e4ad4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba92714f-4d7e-479c-8336-9c91b9e4ad4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb012cd-c77e-4a96-90ec-cd3d4e8b9d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb012cd-c77e-4a96-90ec-cd3d4e8b9d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '025ea195-080a-4126-a1b1-05a0553afdd5', 'volume_name': 'volume-025ea195-080a-4126-a1b1-05a0553afdd5', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5754acc-24a3-47d6-8f10-a7af51e29c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5754acc-24a3-47d6-8f10-a7af51e29c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78fc4724-57a1-4f7b-812e-405d1eac58b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:41 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Volume 025ea195-080a-4126-a1b1-05a0553afdd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-025ea195-080a-4126-a1b1-05a0553afdd5', 'volume_size': 1} Jul 08 14:42:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:42 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0859d624-80d2-4c72-9ae1-0ff1727e6652" returned: 0 in 0.809s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] <== create_volume: return (1795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:42:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.385s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1511864593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=025ea195-080a-4126-a1b1-05a0553afdd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd1454515f584d7fafb18e38d2198294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:42Z,use_quota=True,user_id='289f5df89d494a9e8b49847fd7c8fe66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:42:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Creating volume 025ea195-080a-4126-a1b1-05a0553afdd5 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:42:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:42:42 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:42:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-025ea195-080a-4126-a1b1-05a0553afdd5 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b619e702-dd8c-4a52-94a5-633be275392c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0859d624-80d2-4c72-9ae1-0ff1727e6652', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:42 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-025ea195-080a-4126-a1b1-05a0553afdd5 1073741824 Jul 08 14:42:42 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe340a8-9131-423c-8b93-5689b8728d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:42 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Volume volume-0859d624-80d2-4c72-9ae1-0ff1727e6652 (0859d624-80d2-4c72-9ae1-0ff1727e6652): created successfully Jul 08 14:42:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fe340a8-9131-423c-8b93-5689b8728d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Flow 'volume_create_manager' (b8564318-a5ac-4c34-86d3-8be586b3d310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b2669179-9507-4fd4-87a7-5e33ca289421 tempest-VolumesGetTest-146683015 None] Created volume successfully. Jul 08 14:42:43 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-025ea195-080a-4126-a1b1-05a0553afdd5 1073741824" returned: 0 in 0.993s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-025ea195-080a-4126-a1b1-05a0553afdd5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:43 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-025ea195-080a-4126-a1b1-05a0553afdd5 Jul 08 14:42:43 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c923fa79-03f4-4a74-b949-f912b67a536a tempest-VolumesGetTest-146683015 None] Acquiring lock "cinder-0859d624-80d2-4c72-9ae1-0ff1727e6652-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:42:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c923fa79-03f4-4a74-b949-f912b67a536a tempest-VolumesGetTest-146683015 None] Lock "cinder-0859d624-80d2-4c72-9ae1-0ff1727e6652-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:42:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c923fa79-03f4-4a74-b949-f912b67a536a tempest-VolumesGetTest-146683015 None] Acquiring lock "cinder-quobyte-0859d624-80d2-4c72-9ae1-0ff1727e6652" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:42:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c923fa79-03f4-4a74-b949-f912b67a536a tempest-VolumesGetTest-146683015 None] Lock "cinder-quobyte-0859d624-80d2-4c72-9ae1-0ff1727e6652" acquired by "delete_volume" :: waited 0.088s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:42:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb620c6-f0ee-4618-b85e-12ae6f06ffa8]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c923fa79-03f4-4a74-b949-f912b67a536a tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0859d624-80d2-4c72-9ae1-0ff1727e6652 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:44 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0859d624-80d2-4c72-9ae1-0ff1727e6652 Jul 08 14:42:44 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:44 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-025ea195-080a-4126-a1b1-05a0553afdd5" returned: 0 in 1.266s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] <== create_volume: return (2309ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:42:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.313s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-cdeeac2d-cd3c-47ac-83e0-b3addb1fceda req-e5ba12d1-4bb6-446e-a1bf-8c15548a2998 tempest-TestInstancesWithCinderVolumes-760645170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-cdeeac2d-cd3c-47ac-83e0-b3addb1fceda req-e5ba12d1-4bb6-446e-a1bf-8c15548a2998 tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78fc4724-57a1-4f7b-812e-405d1eac58b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-025ea195-080a-4126-a1b1-05a0553afdd5', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f18a443-003b-45c3-be5a-cbee49dc95a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:44 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Volume volume-025ea195-080a-4126-a1b1-05a0553afdd5 (025ea195-080a-4126-a1b1-05a0553afdd5): created successfully Jul 08 14:42:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f18a443-003b-45c3-be5a-cbee49dc95a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Flow 'volume_create_manager' (346075b4-84f3-4df2-a285-a6eed9d85b98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7094c193-f494-4cdd-9c52-ed68bdc5c643]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-cdeeac2d-cd3c-47ac-83e0-b3addb1fceda req-e5ba12d1-4bb6-446e-a1bf-8c15548a2998 tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0459afba-5399-4569-afbf-0be4621dca5c tempest-VolumesTransfersV355Test-1642862182 None] Created volume successfully. Jul 08 14:42:44 devstack sudo[99842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 Jul 08 14:42:44 devstack sudo[99842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:45 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c923fa79-03f4-4a74-b949-f912b67a536a tempest-VolumesGetTest-146683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0859d624-80d2-4c72-9ae1-0ff1727e6652" returned: 0 in 1.062s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c923fa79-03f4-4a74-b949-f912b67a536a tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0859d624-80d2-4c72-9ae1-0ff1727e6652 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:45 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0859d624-80d2-4c72-9ae1-0ff1727e6652 Jul 08 14:42:45 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:45 devstack sudo[99842]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-cdeeac2d-cd3c-47ac-83e0-b3addb1fceda req-e5ba12d1-4bb6-446e-a1bf-8c15548a2998 tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4" returned: 0 in 1.065s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-cdeeac2d-cd3c-47ac-83e0-b3addb1fceda req-e5ba12d1-4bb6-446e-a1bf-8c15548a2998 tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:45 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 Jul 08 14:42:45 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2e20b79e-089c-41f1-9ed7-ce80761ed671 tempest-VolumesTransfersV355Test-1811422594 None] Transfer volume completed successfully. Jul 08 14:42:46 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c923fa79-03f4-4a74-b949-f912b67a536a tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0859d624-80d2-4c72-9ae1-0ff1727e6652" returned: 0 in 0.962s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c923fa79-03f4-4a74-b949-f912b67a536a tempest-VolumesGetTest-146683015 None] Lock "cinder-quobyte-0859d624-80d2-4c72-9ae1-0ff1727e6652" released by "delete_volume" :: held 2.111s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:46 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-c923fa79-03f4-4a74-b949-f912b67a536a tempest-VolumesGetTest-146683015 None] Created reservations ['02f9f431-0a53-4254-a03e-b76e000836ea', '48a3f772-2dc9-43c8-afc3-7704c1dab4c3', '9c2c3d53-11ea-4c47-9894-45939b39b365', '4953e235-3e20-48d6-9486-e726f7cf1309'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:42:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c923fa79-03f4-4a74-b949-f912b67a536a tempest-VolumesGetTest-146683015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c923fa79-03f4-4a74-b949-f912b67a536a tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c923fa79-03f4-4a74-b949-f912b67a536a tempest-VolumesGetTest-146683015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c923fa79-03f4-4a74-b949-f912b67a536a tempest-VolumesGetTest-146683015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c923fa79-03f4-4a74-b949-f912b67a536a tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c923fa79-03f4-4a74-b949-f912b67a536a tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:46 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:42:46 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:46 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-cdeeac2d-cd3c-47ac-83e0-b3addb1fceda req-e5ba12d1-4bb6-446e-a1bf-8c15548a2998 tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4" returned: 1 in 1.047s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-cdeeac2d-cd3c-47ac-83e0-b3addb1fceda req-e5ba12d1-4bb6-446e-a1bf-8c15548a2998 tempest-TestInstancesWithCinderVolumes-760645170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:42:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-cdeeac2d-cd3c-47ac-83e0-b3addb1fceda req-e5ba12d1-4bb6-446e-a1bf-8c15548a2998 tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.200s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-cdeeac2d-cd3c-47ac-83e0-b3addb1fceda req-e5ba12d1-4bb6-446e-a1bf-8c15548a2998 tempest-TestInstancesWithCinderVolumes-760645170 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad', 'name': 'volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11604704-fe75-42db-8fcc-da53f7323fca', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:42:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-cdeeac2d-cd3c-47ac-83e0-b3addb1fceda req-e5ba12d1-4bb6-446e-a1bf-8c15548a2998 tempest-TestInstancesWithCinderVolumes-760645170 None] attachment_update completed successfully. Jul 08 14:42:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-569adcc9-dab8-4959-9150-1e5ad187eeb5 tempest-VolumesGetTest-146683015 None] Acquiring lock "cinder-17714485-5603-41b4-8a6d-ee113f9d6f6c-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:42:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-569adcc9-dab8-4959-9150-1e5ad187eeb5 tempest-VolumesGetTest-146683015 None] Lock "cinder-17714485-5603-41b4-8a6d-ee113f9d6f6c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:42:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-569adcc9-dab8-4959-9150-1e5ad187eeb5 tempest-VolumesGetTest-146683015 None] Acquiring lock "cinder-quobyte-17714485-5603-41b4-8a6d-ee113f9d6f6c" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:42:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-569adcc9-dab8-4959-9150-1e5ad187eeb5 tempest-VolumesGetTest-146683015 None] Lock "cinder-quobyte-17714485-5603-41b4-8a6d-ee113f9d6f6c" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:42:47 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[561d19b2-df6a-42e7-af15-07b6caa46830]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-569adcc9-dab8-4959-9150-1e5ad187eeb5 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c30cb946-82cb-4fb7-b97b-7f0ad7c73090 tempest-VolumesTransfersV355Test-1196184494 None] Acquiring lock "cinder-025ea195-080a-4126-a1b1-05a0553afdd5-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:42:47 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c30cb946-82cb-4fb7-b97b-7f0ad7c73090 tempest-VolumesTransfersV355Test-1196184494 None] Lock "cinder-025ea195-080a-4126-a1b1-05a0553afdd5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:42:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c923fa79-03f4-4a74-b949-f912b67a536a tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.973s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:47 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-c923fa79-03f4-4a74-b949-f912b67a536a tempest-VolumesGetTest-146683015 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:42:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c923fa79-03f4-4a74-b949-f912b67a536a tempest-VolumesGetTest-146683015 None] Deleted volume successfully. Jul 08 14:42:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c923fa79-03f4-4a74-b949-f912b67a536a tempest-VolumesGetTest-146683015 None] Lock "cinder-0859d624-80d2-4c72-9ae1-0ff1727e6652-delete_volume" released by "delete_volume" :: held 3.557s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:47 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c Jul 08 14:42:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c30cb946-82cb-4fb7-b97b-7f0ad7c73090 tempest-VolumesTransfersV355Test-1196184494 None] Acquiring lock "cinder-quobyte-025ea195-080a-4126-a1b1-05a0553afdd5" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:42:47 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c30cb946-82cb-4fb7-b97b-7f0ad7c73090 tempest-VolumesTransfersV355Test-1196184494 None] Lock "cinder-quobyte-025ea195-080a-4126-a1b1-05a0553afdd5" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:42:47 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96372b3-32c0-46e9-a80d-29950977b94e]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c30cb946-82cb-4fb7-b97b-7f0ad7c73090 tempest-VolumesTransfersV355Test-1196184494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-025ea195-080a-4126-a1b1-05a0553afdd5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:47 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-025ea195-080a-4126-a1b1-05a0553afdd5 Jul 08 14:42:47 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:48 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-569adcc9-dab8-4959-9150-1e5ad187eeb5 tempest-VolumesGetTest-146683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c" returned: 0 in 0.838s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-569adcc9-dab8-4959-9150-1e5ad187eeb5 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:48 devstack sudo[99903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c Jul 08 14:42:48 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:48 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c30cb946-82cb-4fb7-b97b-7f0ad7c73090 tempest-VolumesTransfersV355Test-1196184494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-025ea195-080a-4126-a1b1-05a0553afdd5" returned: 0 in 0.887s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c30cb946-82cb-4fb7-b97b-7f0ad7c73090 tempest-VolumesTransfersV355Test-1196184494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-025ea195-080a-4126-a1b1-05a0553afdd5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:48 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-025ea195-080a-4126-a1b1-05a0553afdd5 Jul 08 14:42:48 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:49 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c30cb946-82cb-4fb7-b97b-7f0ad7c73090 tempest-VolumesTransfersV355Test-1196184494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-025ea195-080a-4126-a1b1-05a0553afdd5" returned: 0 in 0.750s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:49 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-569adcc9-dab8-4959-9150-1e5ad187eeb5 tempest-VolumesGetTest-146683015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c" returned: 1 in 0.993s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-569adcc9-dab8-4959-9150-1e5ad187eeb5 tempest-VolumesGetTest-146683015 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:42:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-569adcc9-dab8-4959-9150-1e5ad187eeb5 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c30cb946-82cb-4fb7-b97b-7f0ad7c73090 tempest-VolumesTransfersV355Test-1196184494 None] Lock "cinder-quobyte-025ea195-080a-4126-a1b1-05a0553afdd5" released by "delete_volume" :: held 1.692s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:49 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c Jul 08 14:42:49 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:49 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-c30cb946-82cb-4fb7-b97b-7f0ad7c73090 tempest-VolumesTransfersV355Test-1196184494 None] Created reservations ['7c801a77-fe4a-47b9-993b-83c64ceeb669', '8ecc2302-9310-45ea-b388-73e93edbb1ab', 'e2f16a43-bb4b-4a79-92ab-c4ed28e9cedc', 'c6b88b7b-e1f4-4c53-b4f1-9c75fcc67b38'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:42:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c30cb946-82cb-4fb7-b97b-7f0ad7c73090 tempest-VolumesTransfersV355Test-1196184494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c30cb946-82cb-4fb7-b97b-7f0ad7c73090 tempest-VolumesTransfersV355Test-1196184494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c30cb946-82cb-4fb7-b97b-7f0ad7c73090 tempest-VolumesTransfersV355Test-1196184494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c30cb946-82cb-4fb7-b97b-7f0ad7c73090 tempest-VolumesTransfersV355Test-1196184494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c30cb946-82cb-4fb7-b97b-7f0ad7c73090 tempest-VolumesTransfersV355Test-1196184494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c30cb946-82cb-4fb7-b97b-7f0ad7c73090 tempest-VolumesTransfersV355Test-1196184494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:49 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:42:49 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:49 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-569adcc9-dab8-4959-9150-1e5ad187eeb5 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-17714485-5603-41b4-8a6d-ee113f9d6f6c" returned: 0 in 0.891s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-569adcc9-dab8-4959-9150-1e5ad187eeb5 tempest-VolumesGetTest-146683015 None] Lock "cinder-quobyte-17714485-5603-41b4-8a6d-ee113f9d6f6c" released by "delete_volume" :: held 2.839s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:50 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c30cb946-82cb-4fb7-b97b-7f0ad7c73090 tempest-VolumesTransfersV355Test-1196184494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.818s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-c30cb946-82cb-4fb7-b97b-7f0ad7c73090 tempest-VolumesTransfersV355Test-1196184494 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:42:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c30cb946-82cb-4fb7-b97b-7f0ad7c73090 tempest-VolumesTransfersV355Test-1196184494 None] Deleted volume successfully. Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-569adcc9-dab8-4959-9150-1e5ad187eeb5 tempest-VolumesGetTest-146683015 None] Created reservations ['196e2175-f8b0-4cbc-b4d5-dee0828e8825', '84f39620-0ef4-4af9-8fe4-a3198dd37016', '554acbb9-0bd5-4a48-b9dc-d12dade5eb07', '906ff651-dadf-4a63-9baa-e2a5725f1a26'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c30cb946-82cb-4fb7-b97b-7f0ad7c73090 tempest-VolumesTransfersV355Test-1196184494 None] Lock "cinder-025ea195-080a-4126-a1b1-05a0553afdd5-delete_volume" released by "delete_volume" :: held 2.849s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-569adcc9-dab8-4959-9150-1e5ad187eeb5 tempest-VolumesGetTest-146683015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-569adcc9-dab8-4959-9150-1e5ad187eeb5 tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-569adcc9-dab8-4959-9150-1e5ad187eeb5 tempest-VolumesGetTest-146683015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-569adcc9-dab8-4959-9150-1e5ad187eeb5 tempest-VolumesGetTest-146683015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-569adcc9-dab8-4959-9150-1e5ad187eeb5 tempest-VolumesGetTest-146683015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-569adcc9-dab8-4959-9150-1e5ad187eeb5 tempest-VolumesGetTest-146683015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:50 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:42:50 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Flow 'volume_create_manager' (9115b6f9-e90e-48d7-89ff-e24acda183a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3068d65a-3e29-467a-b5ac-041ae9936267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3068d65a-3e29-467a-b5ac-041ae9936267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-384407326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5dede14-0632-431c-bbbe-eab0fb162be6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd1454515f584d7fafb18e38d2198294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:50Z,use_quota=True,user_id='289f5df89d494a9e8b49847fd7c8fe66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af48721a-61a1-48c1-a550-50e3771a8962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af48721a-61a1-48c1-a550-50e3771a8962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3727035-d9c2-43b2-a673-77bd493bd6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3727035-d9c2-43b2-a673-77bd493bd6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5dede14-0632-431c-bbbe-eab0fb162be6', 'volume_name': 'volume-b5dede14-0632-431c-bbbe-eab0fb162be6', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a70e585-183c-4890-9519-3d7d8580dfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a70e585-183c-4890-9519-3d7d8580dfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ebae553-44f6-41fd-ba1a-94c11c02447b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:50 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Volume b5dede14-0632-431c-bbbe-eab0fb162be6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5dede14-0632-431c-bbbe-eab0fb162be6', 'volume_size': 1} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-384407326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5dede14-0632-431c-bbbe-eab0fb162be6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd1454515f584d7fafb18e38d2198294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:50Z,use_quota=True,user_id='289f5df89d494a9e8b49847fd7c8fe66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Creating volume b5dede14-0632-431c-bbbe-eab0fb162be6 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:42:50 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:42:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5dede14-0632-431c-bbbe-eab0fb162be6 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:50 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5dede14-0632-431c-bbbe-eab0fb162be6 1073741824 Jul 08 14:42:50 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:51 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-569adcc9-dab8-4959-9150-1e5ad187eeb5 tempest-VolumesGetTest-146683015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.346s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:51 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-569adcc9-dab8-4959-9150-1e5ad187eeb5 tempest-VolumesGetTest-146683015 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:42:51 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-569adcc9-dab8-4959-9150-1e5ad187eeb5 tempest-VolumesGetTest-146683015 None] Deleted volume successfully. Jul 08 14:42:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-569adcc9-dab8-4959-9150-1e5ad187eeb5 tempest-VolumesGetTest-146683015 None] Lock "cinder-17714485-5603-41b4-8a6d-ee113f9d6f6c-delete_volume" released by "delete_volume" :: held 4.576s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:51 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5dede14-0632-431c-bbbe-eab0fb162be6 1073741824" returned: 0 in 1.492s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5dede14-0632-431c-bbbe-eab0fb162be6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:52 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5dede14-0632-431c-bbbe-eab0fb162be6 Jul 08 14:42:52 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:52 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5dede14-0632-431c-bbbe-eab0fb162be6" returned: 0 in 0.943s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] <== create_volume: return (2506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:42:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.511s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ebae553-44f6-41fd-ba1a-94c11c02447b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5dede14-0632-431c-bbbe-eab0fb162be6', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4116d5c6-98c1-4e24-9518-67dc6e011998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:53 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Volume volume-b5dede14-0632-431c-bbbe-eab0fb162be6 (b5dede14-0632-431c-bbbe-eab0fb162be6): created successfully Jul 08 14:42:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4116d5c6-98c1-4e24-9518-67dc6e011998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Flow 'volume_create_manager' (9115b6f9-e90e-48d7-89ff-e24acda183a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:53 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-33296833-c191-4e1b-b002-cef8784022bf tempest-VolumesTransfersV355Test-1642862182 None] Created volume successfully. Jul 08 14:42:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3a8b2962-5fcb-485b-9beb-6b24bef40d82 tempest-VolumesTransfersV355Test-1196184494 None] Acquiring lock "cinder-b5dede14-0632-431c-bbbe-eab0fb162be6-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:42:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3a8b2962-5fcb-485b-9beb-6b24bef40d82 tempest-VolumesTransfersV355Test-1196184494 None] Lock "cinder-b5dede14-0632-431c-bbbe-eab0fb162be6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:42:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3a8b2962-5fcb-485b-9beb-6b24bef40d82 tempest-VolumesTransfersV355Test-1196184494 None] Acquiring lock "cinder-quobyte-b5dede14-0632-431c-bbbe-eab0fb162be6" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:42:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3a8b2962-5fcb-485b-9beb-6b24bef40d82 tempest-VolumesTransfersV355Test-1196184494 None] Lock "cinder-quobyte-b5dede14-0632-431c-bbbe-eab0fb162be6" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:42:54 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e2092d-301a-47bd-815f-99b29c89b87e]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:42:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a8b2962-5fcb-485b-9beb-6b24bef40d82 tempest-VolumesTransfersV355Test-1196184494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5dede14-0632-431c-bbbe-eab0fb162be6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:54 devstack sudo[100389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5dede14-0632-431c-bbbe-eab0fb162be6 Jul 08 14:42:54 devstack sudo[100389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Flow 'volume_create_manager' (3518918b-a490-4739-95f9-42ff38870577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a1e19cb-fd7f-48b7-a012-7825dd28539a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:55 devstack sudo[100389]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a8b2962-5fcb-485b-9beb-6b24bef40d82 tempest-VolumesTransfersV355Test-1196184494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5dede14-0632-431c-bbbe-eab0fb162be6" returned: 0 in 1.286s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a1e19cb-fd7f-48b7-a012-7825dd28539a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-186688203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5299cff-6af2-4161-8632-17c76c86aba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6689c953fd6d4097944b2cefd8a2c03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:55Z,use_quota=True,user_id='765f9496bb8042b389afc57dabe9db54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88e52b7-b2b8-440e-bf97-3e8aa0acb48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d88e52b7-b2b8-440e-bf97-3e8aa0acb48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9192f7-aabd-4944-ad39-636312e00338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9192f7-aabd-4944-ad39-636312e00338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5299cff-6af2-4161-8632-17c76c86aba8', 'volume_name': 'volume-b5299cff-6af2-4161-8632-17c76c86aba8', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4a8704-b34b-4110-8f08-d780ba65c0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a4a8704-b34b-4110-8f08-d780ba65c0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1609c6-d64d-4bea-aed7-ecfc907121d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:55 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Volume b5299cff-6af2-4161-8632-17c76c86aba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5299cff-6af2-4161-8632-17c76c86aba8', 'volume_size': 1} Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-186688203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5299cff-6af2-4161-8632-17c76c86aba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6689c953fd6d4097944b2cefd8a2c03d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:42:55Z,use_quota=True,user_id='765f9496bb8042b389afc57dabe9db54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Creating volume b5299cff-6af2-4161-8632-17c76c86aba8 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:42:55 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a8b2962-5fcb-485b-9beb-6b24bef40d82 tempest-VolumesTransfersV355Test-1196184494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5dede14-0632-431c-bbbe-eab0fb162be6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:55 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8 1073741824 Jul 08 14:42:55 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:55 devstack sudo[100396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5dede14-0632-431c-bbbe-eab0fb162be6 Jul 08 14:42:55 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:56 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a8b2962-5fcb-485b-9beb-6b24bef40d82 tempest-VolumesTransfersV355Test-1196184494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5dede14-0632-431c-bbbe-eab0fb162be6" returned: 0 in 0.943s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3a8b2962-5fcb-485b-9beb-6b24bef40d82 tempest-VolumesTransfersV355Test-1196184494 None] Lock "cinder-quobyte-b5dede14-0632-431c-bbbe-eab0fb162be6" released by "delete_volume" :: held 2.393s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:56 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-3a8b2962-5fcb-485b-9beb-6b24bef40d82 tempest-VolumesTransfersV355Test-1196184494 None] Created reservations ['2d8c433f-6ab7-4163-8ffb-9be959ae4aa5', 'd9300601-c33d-46b5-877d-0b8e7e7a3b79', '049cb62e-4f1e-4aae-be92-c8562d42a440', '326e53fb-c86a-4be1-ba54-0cc4643aaf5c'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:42:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3a8b2962-5fcb-485b-9beb-6b24bef40d82 tempest-VolumesTransfersV355Test-1196184494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3a8b2962-5fcb-485b-9beb-6b24bef40d82 tempest-VolumesTransfersV355Test-1196184494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3a8b2962-5fcb-485b-9beb-6b24bef40d82 tempest-VolumesTransfersV355Test-1196184494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3a8b2962-5fcb-485b-9beb-6b24bef40d82 tempest-VolumesTransfersV355Test-1196184494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3a8b2962-5fcb-485b-9beb-6b24bef40d82 tempest-VolumesTransfersV355Test-1196184494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a8b2962-5fcb-485b-9beb-6b24bef40d82 tempest-VolumesTransfersV355Test-1196184494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:56 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:42:56 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:57 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8 1073741824" returned: 0 in 1.557s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:57 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8 Jul 08 14:42:57 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:42:57 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3a8b2962-5fcb-485b-9beb-6b24bef40d82 tempest-VolumesTransfersV355Test-1196184494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.320s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:58 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-3a8b2962-5fcb-485b-9beb-6b24bef40d82 tempest-VolumesTransfersV355Test-1196184494 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:42:58 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3a8b2962-5fcb-485b-9beb-6b24bef40d82 tempest-VolumesTransfersV355Test-1196184494 None] Deleted volume successfully. Jul 08 14:42:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3a8b2962-5fcb-485b-9beb-6b24bef40d82 tempest-VolumesTransfersV355Test-1196184494 None] Lock "cinder-b5dede14-0632-431c-bbbe-eab0fb162be6-delete_volume" released by "delete_volume" :: held 4.063s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:42:58 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Jul 08 14:42:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8" returned: 0 in 1.401s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:42:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] <== create_volume: return (3022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:42:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.025s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f1609c6-d64d-4bea-aed7-ecfc907121d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5299cff-6af2-4161-8632-17c76c86aba8', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8752d4cb-7303-4405-8e52-cb31d6284aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:42:58 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Volume volume-b5299cff-6af2-4161-8632-17c76c86aba8 (b5299cff-6af2-4161-8632-17c76c86aba8): created successfully Jul 08 14:42:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8752d4cb-7303-4405-8e52-cb31d6284aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:42:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Flow 'volume_create_manager' (3518918b-a490-4739-95f9-42ff38870577) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:42:58 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0da96ead-fc29-42d8-9c5c-6b7d7a931dbe tempest-VolumesSnapshotListTestJSON-1941972136 None] Created volume successfully. Jul 08 14:42:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:42:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:42:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:42:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:42:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:42:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:42:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:42:59 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:42:59 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c1a7aeb0-514d-420d-a345-9cd43790f8eb tempest-VolumesSnapshotListTestJSON-1941972136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c1a7aeb0-514d-420d-a345-9cd43790f8eb tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c1a7aeb0-514d-420d-a345-9cd43790f8eb tempest-VolumesSnapshotListTestJSON-1941972136 None] Creating offline snapshot ed7700ab-096d-408c-89fe-f1e22857b179 of volume b5299cff-6af2-4161-8632-17c76c86aba8 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:43:00 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[617e1280-5f3f-40e0-b9d1-d43ce7f21c42]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1a7aeb0-514d-420d-a345-9cd43790f8eb tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:00 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8 Jul 08 14:43:00 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:00 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.343s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:43:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:43:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:43:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:43:01 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1a7aeb0-514d-420d-a345-9cd43790f8eb tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8" returned: 0 in 1.438s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1a7aeb0-514d-420d-a345-9cd43790f8eb tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:01 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179 1G Jul 08 14:43:01 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:03 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1a7aeb0-514d-420d-a345-9cd43790f8eb tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179 1G" returned: 0 in 1.490s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1a7aeb0-514d-420d-a345-9cd43790f8eb tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5299cff-6af2-4161-8632-17c76c86aba8 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:03 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5299cff-6af2-4161-8632-17c76c86aba8 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179 Jul 08 14:43:03 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:04 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1a7aeb0-514d-420d-a345-9cd43790f8eb tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5299cff-6af2-4161-8632-17c76c86aba8 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179" returned: 0 in 0.954s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:04 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-c1a7aeb0-514d-420d-a345-9cd43790f8eb tempest-VolumesSnapshotListTestJSON-1941972136 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179 is being set with open permissions: ugo+rw Jul 08 14:43:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1a7aeb0-514d-420d-a345-9cd43790f8eb tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:04 devstack sudo[100435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179 Jul 08 14:43:04 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:05 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1a7aeb0-514d-420d-a345-9cd43790f8eb tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179" returned: 0 in 0.958s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1a7aeb0-514d-420d-a345-9cd43790f8eb tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:05 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.info Jul 08 14:43:05 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:06 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1a7aeb0-514d-420d-a345-9cd43790f8eb tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.info" returned: 0 in 1.024s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:06 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-c1a7aeb0-514d-420d-a345-9cd43790f8eb tempest-VolumesSnapshotListTestJSON-1941972136 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.info is being set with open permissions: ugo+rw Jul 08 14:43:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1a7aeb0-514d-420d-a345-9cd43790f8eb tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:06 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.info Jul 08 14:43:06 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:07 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1a7aeb0-514d-420d-a345-9cd43790f8eb tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.info" returned: 0 in 0.931s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c1a7aeb0-514d-420d-a345-9cd43790f8eb tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.946s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:07 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=105,cinder:SELECT=79,cinder:INSERT=35,cinder:DELETE=10 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:43:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c1a7aeb0-514d-420d-a345-9cd43790f8eb tempest-VolumesSnapshotListTestJSON-1941972136 None] Create snapshot completed successfully Jul 08 14:43:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fb8626ff-9a13-4aae-9176-bfaaf1c6d503 tempest-VolumesSnapshotListTestJSON-1941972136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fb8626ff-9a13-4aae-9176-bfaaf1c6d503 tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-fb8626ff-9a13-4aae-9176-bfaaf1c6d503 tempest-VolumesSnapshotListTestJSON-1941972136 None] Creating offline snapshot 2ee93b13-12c5-44b1-945d-c641dde02d3f of volume b5299cff-6af2-4161-8632-17c76c86aba8 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:43:08 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[72630f4c-2bb7-4dc8-9505-93a2aa0cef3d]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fb8626ff-9a13-4aae-9176-bfaaf1c6d503 tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:08 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179 Jul 08 14:43:08 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:09 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fb8626ff-9a13-4aae-9176-bfaaf1c6d503 tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179" returned: 0 in 0.960s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-fb8626ff-9a13-4aae-9176-bfaaf1c6d503 tempest-VolumesSnapshotListTestJSON-1941972136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5299cff-6af2-4161-8632-17c76c86aba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:43:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fb8626ff-9a13-4aae-9176-bfaaf1c6d503 tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:09 devstack sudo[100450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f 1G Jul 08 14:43:09 devstack sudo[100450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:09 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=103,cinder:SELECT=90,cinder:INSERT=31,cinder:DELETE=10 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:43:09 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:43:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Flow 'volume_create_manager' (6cfce3b7-8736-4376-94da-676635c76760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:43:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb20814-25a3-42cc-b279-de729a92ed0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb20814-25a3-42cc-b279-de729a92ed0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1477385321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0e5c583c462453d8aa9531ee67c25ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:43:10Z,use_quota=True,user_id='8637a4b8a9ee420ea5615ee5ac34f318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7803f01b-09b3-451a-86ca-7bfeea0d30ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7803f01b-09b3-451a-86ca-7bfeea0d30ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89dc3320-2b30-47e4-bdbb-4d8a36865490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89dc3320-2b30-47e4-bdbb-4d8a36865490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d', 'volume_name': 'volume-02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c388dba6-778c-47ad-b5f4-eface874d810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c388dba6-778c-47ad-b5f4-eface874d810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19f4e750-ea5b-4796-bd87-822addbb6295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:10 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Volume 02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d', 'volume_size': 1} Jul 08 14:43:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:10 devstack sudo[100450]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fb8626ff-9a13-4aae-9176-bfaaf1c6d503 tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f 1G" returned: 0 in 1.080s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fb8626ff-9a13-4aae-9176-bfaaf1c6d503 tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:10 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f Jul 08 14:43:10 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:10 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fb8626ff-9a13-4aae-9176-bfaaf1c6d503 tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f" returned: 0 in 0.881s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:10 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-fb8626ff-9a13-4aae-9176-bfaaf1c6d503 tempest-VolumesSnapshotListTestJSON-1941972136 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f is being set with open permissions: ugo+rw Jul 08 14:43:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fb8626ff-9a13-4aae-9176-bfaaf1c6d503 tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:10 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f Jul 08 14:43:10 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:11 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fb8626ff-9a13-4aae-9176-bfaaf1c6d503 tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f" returned: 0 in 0.726s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fb8626ff-9a13-4aae-9176-bfaaf1c6d503 tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.771s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.717s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:43:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1477385321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0e5c583c462453d8aa9531ee67c25ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:43:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:43:10Z,use_quota=True,user_id='8637a4b8a9ee420ea5615ee5ac34f318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:43:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Creating volume 02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:43:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:43:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:43:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:43:11 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:43:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:11 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d 1073741824 Jul 08 14:43:11 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:11 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fb8626ff-9a13-4aae-9176-bfaaf1c6d503 tempest-VolumesSnapshotListTestJSON-1941972136 None] Create snapshot completed successfully Jul 08 14:43:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-51ae1afa-d8ae-4773-b3e9-94ad4a4555e1 tempest-VolumesSnapshotListTestJSON-1941972136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:12 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d 1073741824" returned: 0 in 0.899s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:12 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d Jul 08 14:43:12 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:13 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d" returned: 0 in 0.681s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:43:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-51ae1afa-d8ae-4773-b3e9-94ad4a4555e1 tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.033s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:13 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19f4e750-ea5b-4796-bd87-822addbb6295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:13 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b93827ef-495a-40ed-b5c6-ad25741b8f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-51ae1afa-d8ae-4773-b3e9-94ad4a4555e1 tempest-VolumesSnapshotListTestJSON-1941972136 None] Creating offline snapshot ed899ba4-02c3-488c-af85-bb5f18daa6dc of volume b5299cff-6af2-4161-8632-17c76c86aba8 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:43:13 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f259aeb-3193-4d61-9277-2e929e6eecde]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-51ae1afa-d8ae-4773-b3e9-94ad4a4555e1 tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:13 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Volume volume-02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d (02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d): created successfully Jul 08 14:43:13 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b93827ef-495a-40ed-b5c6-ad25741b8f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:13 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Flow 'volume_create_manager' (6cfce3b7-8736-4376-94da-676635c76760) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:43:13 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-aa0a1913-441e-46a5-b79d-b94845b0c5ae tempest-VolumesListTestJSON-1440128567 None] Created volume successfully. Jul 08 14:43:13 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f Jul 08 14:43:13 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:14 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-51ae1afa-d8ae-4773-b3e9-94ad4a4555e1 tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f" returned: 0 in 0.885s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-51ae1afa-d8ae-4773-b3e9-94ad4a4555e1 tempest-VolumesSnapshotListTestJSON-1941972136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5299cff-6af2-4161-8632-17c76c86aba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:43:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-51ae1afa-d8ae-4773-b3e9-94ad4a4555e1 tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed899ba4-02c3-488c-af85-bb5f18daa6dc 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:14 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed899ba4-02c3-488c-af85-bb5f18daa6dc 1G Jul 08 14:43:14 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:14 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:43:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Flow 'volume_create_manager' (ec5f246f-437c-4a20-afdb-7eada803d2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:43:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc46f43-7484-425f-94f9-32d4bda59cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfc46f43-7484-425f-94f9-32d4bda59cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1931749526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aceb24a-ecba-471f-b288-d6aa35ee8e77,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0e5c583c462453d8aa9531ee67c25ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:43:15Z,use_quota=True,user_id='8637a4b8a9ee420ea5615ee5ac34f318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4dd4ef-2798-4785-b176-4f733e49a013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e4dd4ef-2798-4785-b176-4f733e49a013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e3d04b-c96f-4afa-b1f7-68be54aec926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7e3d04b-c96f-4afa-b1f7-68be54aec926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aceb24a-ecba-471f-b288-d6aa35ee8e77', 'volume_name': 'volume-5aceb24a-ecba-471f-b288-d6aa35ee8e77', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f361ce-186e-4498-a9de-b509f4056281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f361ce-186e-4498-a9de-b509f4056281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4878bf36-fddd-4d55-9347-109896dfd5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:14 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Volume 5aceb24a-ecba-471f-b288-d6aa35ee8e77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aceb24a-ecba-471f-b288-d6aa35ee8e77', 'volume_size': 1} Jul 08 14:43:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:15 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-51ae1afa-d8ae-4773-b3e9-94ad4a4555e1 tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed899ba4-02c3-488c-af85-bb5f18daa6dc 1G" returned: 0 in 1.131s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-51ae1afa-d8ae-4773-b3e9-94ad4a4555e1 tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed899ba4-02c3-488c-af85-bb5f18daa6dc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:15 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed899ba4-02c3-488c-af85-bb5f18daa6dc Jul 08 14:43:15 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:16 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-51ae1afa-d8ae-4773-b3e9-94ad4a4555e1 tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed899ba4-02c3-488c-af85-bb5f18daa6dc" returned: 0 in 0.721s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:16 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-51ae1afa-d8ae-4773-b3e9-94ad4a4555e1 tempest-VolumesSnapshotListTestJSON-1941972136 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed899ba4-02c3-488c-af85-bb5f18daa6dc is being set with open permissions: ugo+rw Jul 08 14:43:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-51ae1afa-d8ae-4773-b3e9-94ad4a4555e1 tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed899ba4-02c3-488c-af85-bb5f18daa6dc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:16 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed899ba4-02c3-488c-af85-bb5f18daa6dc Jul 08 14:43:16 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:16 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-51ae1afa-d8ae-4773-b3e9-94ad4a4555e1 tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed899ba4-02c3-488c-af85-bb5f18daa6dc" returned: 0 in 0.705s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-51ae1afa-d8ae-4773-b3e9-94ad4a4555e1 tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.567s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.061s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1931749526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aceb24a-ecba-471f-b288-d6aa35ee8e77,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0e5c583c462453d8aa9531ee67c25ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:43:15Z,use_quota=True,user_id='8637a4b8a9ee420ea5615ee5ac34f318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:43:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Creating volume 5aceb24a-ecba-471f-b288-d6aa35ee8e77 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:43:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:43:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:43:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:43:16 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:43:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5aceb24a-ecba-471f-b288-d6aa35ee8e77 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:16 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5aceb24a-ecba-471f-b288-d6aa35ee8e77 1073741824 Jul 08 14:43:16 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:16 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-51ae1afa-d8ae-4773-b3e9-94ad4a4555e1 tempest-VolumesSnapshotListTestJSON-1941972136 None] Create snapshot completed successfully Jul 08 14:43:17 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5aceb24a-ecba-471f-b288-d6aa35ee8e77 1073741824" returned: 0 in 1.004s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5aceb24a-ecba-471f-b288-d6aa35ee8e77 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:18 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5aceb24a-ecba-471f-b288-d6aa35ee8e77 Jul 08 14:43:18 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c4a5208e-82da-44b9-90d2-8f29f3923e74 tempest-VolumesSnapshotListTestJSON-1941972136 None] Acquiring lock "cinder-ed899ba4-02c3-488c-af85-bb5f18daa6dc-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c4a5208e-82da-44b9-90d2-8f29f3923e74 tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "cinder-ed899ba4-02c3-488c-af85-bb5f18daa6dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c4a5208e-82da-44b9-90d2-8f29f3923e74 tempest-VolumesSnapshotListTestJSON-1941972136 None] Acquiring lock "cinder-quobyte-b5299cff-6af2-4161-8632-17c76c86aba8" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c4a5208e-82da-44b9-90d2-8f29f3923e74 tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "cinder-quobyte-b5299cff-6af2-4161-8632-17c76c86aba8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c4a5208e-82da-44b9-90d2-8f29f3923e74 tempest-VolumesSnapshotListTestJSON-1941972136 None] Acquiring lock "cinder-quobyte-ed899ba4-02c3-488c-af85-bb5f18daa6dc" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c4a5208e-82da-44b9-90d2-8f29f3923e74 tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "cinder-quobyte-ed899ba4-02c3-488c-af85-bb5f18daa6dc" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c4a5208e-82da-44b9-90d2-8f29f3923e74 tempest-VolumesSnapshotListTestJSON-1941972136 None] Deleting offline snapshot ed899ba4-02c3-488c-af85-bb5f18daa6dc of volume b5299cff-6af2-4161-8632-17c76c86aba8 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:43:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c4a5208e-82da-44b9-90d2-8f29f3923e74 tempest-VolumesSnapshotListTestJSON-1941972136 None] snapshot_file for this snap is: volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed899ba4-02c3-488c-af85-bb5f18daa6dc {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:43:18 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dbd921-41d6-475c-b00b-3181316913d3]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c4a5208e-82da-44b9-90d2-8f29f3923e74 tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed899ba4-02c3-488c-af85-bb5f18daa6dc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:18 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5aceb24a-ecba-471f-b288-d6aa35ee8e77" returned: 0 in 0.774s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:43:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:18 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed899ba4-02c3-488c-af85-bb5f18daa6dc Jul 08 14:43:18 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4878bf36-fddd-4d55-9347-109896dfd5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aceb24a-ecba-471f-b288-d6aa35ee8e77', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a81909-302a-4484-b961-d8be4d39e6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:18 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Volume volume-5aceb24a-ecba-471f-b288-d6aa35ee8e77 (5aceb24a-ecba-471f-b288-d6aa35ee8e77): created successfully Jul 08 14:43:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a81909-302a-4484-b961-d8be4d39e6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Flow 'volume_create_manager' (ec5f246f-437c-4a20-afdb-7eada803d2f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:43:18 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-165616ae-69ea-4628-b8ac-22c5e0c7c692 tempest-VolumesListTestJSON-1440128567 None] Created volume successfully. Jul 08 14:43:19 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c4a5208e-82da-44b9-90d2-8f29f3923e74 tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed899ba4-02c3-488c-af85-bb5f18daa6dc" returned: 0 in 1.060s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c4a5208e-82da-44b9-90d2-8f29f3923e74 tempest-VolumesSnapshotListTestJSON-1941972136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5299cff-6af2-4161-8632-17c76c86aba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb980de-70b0-4b24-b544-a5e47f953833]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c4a5208e-82da-44b9-90d2-8f29f3923e74 tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Flow 'volume_create_manager' (d17cee5e-a876-4e5e-808f-353a0b34d947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a14acf-ef02-463e-924e-2d52f451624d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00a14acf-ef02-463e-924e-2d52f451624d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-798046664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f88e82e-d066-4ff0-824f-5b51b5fa101e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0e5c583c462453d8aa9531ee67c25ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:43:20Z,use_quota=True,user_id='8637a4b8a9ee420ea5615ee5ac34f318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09a631b-bfa8-42c0-b886-6daf6c7a82a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09a631b-bfa8-42c0-b886-6daf6c7a82a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7750d3f2-4ea4-4c42-916b-770059f9dbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7750d3f2-4ea4-4c42-916b-770059f9dbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f88e82e-d066-4ff0-824f-5b51b5fa101e', 'volume_name': 'volume-3f88e82e-d066-4ff0-824f-5b51b5fa101e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea630f6-c949-4f0c-a6b3-eaa5f84320a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea630f6-c949-4f0c-a6b3-eaa5f84320a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3acfab80-7e6b-4f80-ab45-1f978d6d5295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:19 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Volume 3f88e82e-d066-4ff0-824f-5b51b5fa101e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f88e82e-d066-4ff0-824f-5b51b5fa101e', 'volume_size': 1} Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-798046664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f88e82e-d066-4ff0-824f-5b51b5fa101e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0e5c583c462453d8aa9531ee67c25ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:43:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:43:20Z,use_quota=True,user_id='8637a4b8a9ee420ea5615ee5ac34f318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Creating volume 3f88e82e-d066-4ff0-824f-5b51b5fa101e {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:43:19 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f Jul 08 14:43:19 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:43:19 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:43:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f88e82e-d066-4ff0-824f-5b51b5fa101e 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:19 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f88e82e-d066-4ff0-824f-5b51b5fa101e 1073741824 Jul 08 14:43:19 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:20 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c4a5208e-82da-44b9-90d2-8f29f3923e74 tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f" returned: 0 in 0.907s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c4a5208e-82da-44b9-90d2-8f29f3923e74 tempest-VolumesSnapshotListTestJSON-1941972136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5299cff-6af2-4161-8632-17c76c86aba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:43:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c4a5208e-82da-44b9-90d2-8f29f3923e74 tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed899ba4-02c3-488c-af85-bb5f18daa6dc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:20 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed899ba4-02c3-488c-af85-bb5f18daa6dc Jul 08 14:43:20 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:21 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f88e82e-d066-4ff0-824f-5b51b5fa101e 1073741824" returned: 0 in 1.174s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f88e82e-d066-4ff0-824f-5b51b5fa101e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:21 devstack sudo[100612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f88e82e-d066-4ff0-824f-5b51b5fa101e Jul 08 14:43:21 devstack sudo[100612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:21 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c4a5208e-82da-44b9-90d2-8f29f3923e74 tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed899ba4-02c3-488c-af85-bb5f18daa6dc" returned: 0 in 1.131s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c4a5208e-82da-44b9-90d2-8f29f3923e74 tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed899ba4-02c3-488c-af85-bb5f18daa6dc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:21 devstack sudo[100620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed899ba4-02c3-488c-af85-bb5f18daa6dc Jul 08 14:43:21 devstack sudo[100620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:21 devstack sudo[100612]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f88e82e-d066-4ff0-824f-5b51b5fa101e" returned: 0 in 0.771s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:21 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:43:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:21 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3acfab80-7e6b-4f80-ab45-1f978d6d5295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f88e82e-d066-4ff0-824f-5b51b5fa101e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:21 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b740891b-e60f-4220-901c-42c30c3f0b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:21 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Volume volume-3f88e82e-d066-4ff0-824f-5b51b5fa101e (3f88e82e-d066-4ff0-824f-5b51b5fa101e): created successfully Jul 08 14:43:21 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b740891b-e60f-4220-901c-42c30c3f0b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:21 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Flow 'volume_create_manager' (d17cee5e-a876-4e5e-808f-353a0b34d947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:43:21 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4c502ba4-a0db-4402-8c8e-21fc9a3549bd tempest-VolumesListTestJSON-1440128567 None] Created volume successfully. Jul 08 14:43:22 devstack sudo[100620]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c4a5208e-82da-44b9-90d2-8f29f3923e74 tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed899ba4-02c3-488c-af85-bb5f18daa6dc" returned: 0 in 0.688s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c4a5208e-82da-44b9-90d2-8f29f3923e74 tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "cinder-quobyte-ed899ba4-02c3-488c-af85-bb5f18daa6dc" released by "_delete_snapshot" :: held 3.896s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c4a5208e-82da-44b9-90d2-8f29f3923e74 tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "cinder-quobyte-b5299cff-6af2-4161-8632-17c76c86aba8" released by "delete_snapshot" :: held 3.924s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:22 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-c4a5208e-82da-44b9-90d2-8f29f3923e74 tempest-VolumesSnapshotListTestJSON-1941972136 None] Created reservations ['76ffa07a-339a-4d2c-b585-11165b75064e', '851412f8-ae04-4d4d-8ec0-00eb3a245ae3', '7063671c-261c-451a-a581-a593694d211b', '70a13bf1-50c1-4212-8e90-5018acea6034'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:43:22 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c4a5208e-82da-44b9-90d2-8f29f3923e74 tempest-VolumesSnapshotListTestJSON-1941972136 None] Delete snapshot completed successfully. Jul 08 14:43:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c4a5208e-82da-44b9-90d2-8f29f3923e74 tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "cinder-ed899ba4-02c3-488c-af85-bb5f18daa6dc-delete_snapshot" released by "delete_snapshot" :: held 4.120s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-af1aafbc-d01d-4e66-a412-fe15e55fbbfb tempest-VolumesSnapshotListTestJSON-1941972136 None] Acquiring lock "cinder-2ee93b13-12c5-44b1-945d-c641dde02d3f-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-af1aafbc-d01d-4e66-a412-fe15e55fbbfb tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "cinder-2ee93b13-12c5-44b1-945d-c641dde02d3f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-af1aafbc-d01d-4e66-a412-fe15e55fbbfb tempest-VolumesSnapshotListTestJSON-1941972136 None] Acquiring lock "cinder-quobyte-b5299cff-6af2-4161-8632-17c76c86aba8" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-af1aafbc-d01d-4e66-a412-fe15e55fbbfb tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "cinder-quobyte-b5299cff-6af2-4161-8632-17c76c86aba8" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-af1aafbc-d01d-4e66-a412-fe15e55fbbfb tempest-VolumesSnapshotListTestJSON-1941972136 None] Acquiring lock "cinder-quobyte-2ee93b13-12c5-44b1-945d-c641dde02d3f" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-af1aafbc-d01d-4e66-a412-fe15e55fbbfb tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "cinder-quobyte-2ee93b13-12c5-44b1-945d-c641dde02d3f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-af1aafbc-d01d-4e66-a412-fe15e55fbbfb tempest-VolumesSnapshotListTestJSON-1941972136 None] Deleting offline snapshot 2ee93b13-12c5-44b1-945d-c641dde02d3f of volume b5299cff-6af2-4161-8632-17c76c86aba8 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:43:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-af1aafbc-d01d-4e66-a412-fe15e55fbbfb tempest-VolumesSnapshotListTestJSON-1941972136 None] snapshot_file for this snap is: volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:43:22 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d0197c-2670-4fd2-a404-4c76db487fb8]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af1aafbc-d01d-4e66-a412-fe15e55fbbfb tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:23 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f Jul 08 14:43:23 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:23 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af1aafbc-d01d-4e66-a412-fe15e55fbbfb tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f" returned: 0 in 0.897s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-af1aafbc-d01d-4e66-a412-fe15e55fbbfb tempest-VolumesSnapshotListTestJSON-1941972136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5299cff-6af2-4161-8632-17c76c86aba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:43:23 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19be299-dfd2-483d-9521-cb5dc0637262]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af1aafbc-d01d-4e66-a412-fe15e55fbbfb tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:24 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179 Jul 08 14:43:24 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:24 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af1aafbc-d01d-4e66-a412-fe15e55fbbfb tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179" returned: 0 in 0.888s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-af1aafbc-d01d-4e66-a412-fe15e55fbbfb tempest-VolumesSnapshotListTestJSON-1941972136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5299cff-6af2-4161-8632-17c76c86aba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:43:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af1aafbc-d01d-4e66-a412-fe15e55fbbfb tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:24 devstack sudo[100633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f Jul 08 14:43:24 devstack sudo[100633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5a9993c1-c6c4-42dc-9e67-179d8de24efb tempest-VolumesListTestJSON-1440128567 None] Acquiring lock "cinder-3f88e82e-d066-4ff0-824f-5b51b5fa101e-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5a9993c1-c6c4-42dc-9e67-179d8de24efb tempest-VolumesListTestJSON-1440128567 None] Lock "cinder-3f88e82e-d066-4ff0-824f-5b51b5fa101e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5a9993c1-c6c4-42dc-9e67-179d8de24efb tempest-VolumesListTestJSON-1440128567 None] Acquiring lock "cinder-quobyte-3f88e82e-d066-4ff0-824f-5b51b5fa101e" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5a9993c1-c6c4-42dc-9e67-179d8de24efb tempest-VolumesListTestJSON-1440128567 None] Lock "cinder-quobyte-3f88e82e-d066-4ff0-824f-5b51b5fa101e" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:25 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7133857f-13c3-498a-8ad2-8ed2da56f291]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5a9993c1-c6c4-42dc-9e67-179d8de24efb tempest-VolumesListTestJSON-1440128567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f88e82e-d066-4ff0-824f-5b51b5fa101e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:25 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f88e82e-d066-4ff0-824f-5b51b5fa101e Jul 08 14:43:25 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:25 devstack sudo[100633]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af1aafbc-d01d-4e66-a412-fe15e55fbbfb tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f" returned: 0 in 0.972s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af1aafbc-d01d-4e66-a412-fe15e55fbbfb tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:25 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f Jul 08 14:43:25 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:26 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5a9993c1-c6c4-42dc-9e67-179d8de24efb tempest-VolumesListTestJSON-1440128567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f88e82e-d066-4ff0-824f-5b51b5fa101e" returned: 0 in 0.986s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5a9993c1-c6c4-42dc-9e67-179d8de24efb tempest-VolumesListTestJSON-1440128567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f88e82e-d066-4ff0-824f-5b51b5fa101e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:26 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f88e82e-d066-4ff0-824f-5b51b5fa101e Jul 08 14:43:26 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:26 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af1aafbc-d01d-4e66-a412-fe15e55fbbfb tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.2ee93b13-12c5-44b1-945d-c641dde02d3f" returned: 0 in 0.851s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-af1aafbc-d01d-4e66-a412-fe15e55fbbfb tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "cinder-quobyte-2ee93b13-12c5-44b1-945d-c641dde02d3f" released by "_delete_snapshot" :: held 3.738s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-af1aafbc-d01d-4e66-a412-fe15e55fbbfb tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "cinder-quobyte-b5299cff-6af2-4161-8632-17c76c86aba8" released by "delete_snapshot" :: held 3.770s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:26 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-af1aafbc-d01d-4e66-a412-fe15e55fbbfb tempest-VolumesSnapshotListTestJSON-1941972136 None] Created reservations ['8487680d-8f77-4a4d-b4ca-1979f29f1754', '515bccb7-4cd9-413c-87a0-f5b915f38040', '776f355f-e5ed-4f96-98bc-5cdcfc3dc05f', '2c72502a-709e-4a43-b199-6e69e76e5790'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:43:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-af1aafbc-d01d-4e66-a412-fe15e55fbbfb tempest-VolumesSnapshotListTestJSON-1941972136 None] Delete snapshot completed successfully. Jul 08 14:43:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-af1aafbc-d01d-4e66-a412-fe15e55fbbfb tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "cinder-2ee93b13-12c5-44b1-945d-c641dde02d3f-delete_snapshot" released by "delete_snapshot" :: held 3.947s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:27 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5a9993c1-c6c4-42dc-9e67-179d8de24efb tempest-VolumesListTestJSON-1440128567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f88e82e-d066-4ff0-824f-5b51b5fa101e" returned: 0 in 0.786s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c4cf0805-f75f-4bd6-affb-5d882dcef056 tempest-VolumesSnapshotListTestJSON-1941972136 None] Acquiring lock "cinder-ed7700ab-096d-408c-89fe-f1e22857b179-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5a9993c1-c6c4-42dc-9e67-179d8de24efb tempest-VolumesListTestJSON-1440128567 None] Lock "cinder-quobyte-3f88e82e-d066-4ff0-824f-5b51b5fa101e" released by "delete_volume" :: held 1.848s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c4cf0805-f75f-4bd6-affb-5d882dcef056 tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "cinder-ed7700ab-096d-408c-89fe-f1e22857b179-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c4cf0805-f75f-4bd6-affb-5d882dcef056 tempest-VolumesSnapshotListTestJSON-1941972136 None] Acquiring lock "cinder-quobyte-b5299cff-6af2-4161-8632-17c76c86aba8" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c4cf0805-f75f-4bd6-affb-5d882dcef056 tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "cinder-quobyte-b5299cff-6af2-4161-8632-17c76c86aba8" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c4cf0805-f75f-4bd6-affb-5d882dcef056 tempest-VolumesSnapshotListTestJSON-1941972136 None] Acquiring lock "cinder-quobyte-ed7700ab-096d-408c-89fe-f1e22857b179" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c4cf0805-f75f-4bd6-affb-5d882dcef056 tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "cinder-quobyte-ed7700ab-096d-408c-89fe-f1e22857b179" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c4cf0805-f75f-4bd6-affb-5d882dcef056 tempest-VolumesSnapshotListTestJSON-1941972136 None] Deleting offline snapshot ed7700ab-096d-408c-89fe-f1e22857b179 of volume b5299cff-6af2-4161-8632-17c76c86aba8 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c4cf0805-f75f-4bd6-affb-5d882dcef056 tempest-VolumesSnapshotListTestJSON-1941972136 None] snapshot_file for this snap is: volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-5a9993c1-c6c4-42dc-9e67-179d8de24efb tempest-VolumesListTestJSON-1440128567 None] Created reservations ['e1b8f87c-fb33-4e19-b755-54e90c9778fd', '4cc1d9ab-79b5-426d-af26-bce0ede11629', '9e78fa1a-f1af-46ea-80b3-cf5c5d2bf97a', 'e0de6711-0914-4378-8c20-a57a4a019df3'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[48630371-9e69-4abd-9675-c191594e4b6e]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c4cf0805-f75f-4bd6-affb-5d882dcef056 tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:27 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179 Jul 08 14:43:27 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5a9993c1-c6c4-42dc-9e67-179d8de24efb tempest-VolumesListTestJSON-1440128567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5a9993c1-c6c4-42dc-9e67-179d8de24efb tempest-VolumesListTestJSON-1440128567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5a9993c1-c6c4-42dc-9e67-179d8de24efb tempest-VolumesListTestJSON-1440128567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5a9993c1-c6c4-42dc-9e67-179d8de24efb tempest-VolumesListTestJSON-1440128567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5a9993c1-c6c4-42dc-9e67-179d8de24efb tempest-VolumesListTestJSON-1440128567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5a9993c1-c6c4-42dc-9e67-179d8de24efb tempest-VolumesListTestJSON-1440128567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:27 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:43:27 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5133e2d1-f741-4ba9-80a9-e4e92aebd5fd tempest-VolumesListTestJSON-1440128567 None] Acquiring lock "cinder-5aceb24a-ecba-471f-b288-d6aa35ee8e77-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5133e2d1-f741-4ba9-80a9-e4e92aebd5fd tempest-VolumesListTestJSON-1440128567 None] Lock "cinder-5aceb24a-ecba-471f-b288-d6aa35ee8e77-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5133e2d1-f741-4ba9-80a9-e4e92aebd5fd tempest-VolumesListTestJSON-1440128567 None] Acquiring lock "cinder-quobyte-5aceb24a-ecba-471f-b288-d6aa35ee8e77" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5133e2d1-f741-4ba9-80a9-e4e92aebd5fd tempest-VolumesListTestJSON-1440128567 None] Lock "cinder-quobyte-5aceb24a-ecba-471f-b288-d6aa35ee8e77" acquired by "delete_volume" :: waited 0.035s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c83adf0-92c8-42a0-82be-cb600988aa07]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5133e2d1-f741-4ba9-80a9-e4e92aebd5fd tempest-VolumesListTestJSON-1440128567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5aceb24a-ecba-471f-b288-d6aa35ee8e77 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:28 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5aceb24a-ecba-471f-b288-d6aa35ee8e77 Jul 08 14:43:28 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:28 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c4cf0805-f75f-4bd6-affb-5d882dcef056 tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179" returned: 0 in 1.277s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c4cf0805-f75f-4bd6-affb-5d882dcef056 tempest-VolumesSnapshotListTestJSON-1941972136 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5299cff-6af2-4161-8632-17c76c86aba8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:43:28 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7906c570-fa28-410e-9cae-2a937cafe6c9]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c4cf0805-f75f-4bd6-affb-5d882dcef056 tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:28 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5a9993c1-c6c4-42dc-9e67-179d8de24efb tempest-VolumesListTestJSON-1440128567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.197s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:28 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-5a9993c1-c6c4-42dc-9e67-179d8de24efb tempest-VolumesListTestJSON-1440128567 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:43:28 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5a9993c1-c6c4-42dc-9e67-179d8de24efb tempest-VolumesListTestJSON-1440128567 None] Deleted volume successfully. Jul 08 14:43:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5a9993c1-c6c4-42dc-9e67-179d8de24efb tempest-VolumesListTestJSON-1440128567 None] Lock "cinder-3f88e82e-d066-4ff0-824f-5b51b5fa101e-delete_volume" released by "delete_volume" :: held 3.499s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:28 devstack sudo[100667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8 Jul 08 14:43:28 devstack sudo[100667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:29 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5133e2d1-f741-4ba9-80a9-e4e92aebd5fd tempest-VolumesListTestJSON-1440128567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5aceb24a-ecba-471f-b288-d6aa35ee8e77" returned: 0 in 1.324s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5133e2d1-f741-4ba9-80a9-e4e92aebd5fd tempest-VolumesListTestJSON-1440128567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5aceb24a-ecba-471f-b288-d6aa35ee8e77 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:29 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5aceb24a-ecba-471f-b288-d6aa35ee8e77 Jul 08 14:43:29 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-d9855fc2-f001-4e7a-8a8d-f127d8a99641 req-8b69bf82-204c-41f1-b3e6-b46e0616bc71 tempest-TestInstancesWithCinderVolumes-760645170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-d9855fc2-f001-4e7a-8a8d-f127d8a99641 req-8b69bf82-204c-41f1-b3e6-b46e0616bc71 tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:29 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3592ba3-50fc-45ee-861b-57f0a7c7b20f]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-d9855fc2-f001-4e7a-8a8d-f127d8a99641 req-8b69bf82-204c-41f1-b3e6-b46e0616bc71 tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8684fee8-e72a-4f76-9c33-a0963b44e832 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:29 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8684fee8-e72a-4f76-9c33-a0963b44e832 Jul 08 14:43:29 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:29 devstack sudo[100667]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c4cf0805-f75f-4bd6-affb-5d882dcef056 tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8" returned: 0 in 1.114s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c4cf0805-f75f-4bd6-affb-5d882dcef056 tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:29 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179 Jul 08 14:43:29 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:30 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5133e2d1-f741-4ba9-80a9-e4e92aebd5fd tempest-VolumesListTestJSON-1440128567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-5aceb24a-ecba-471f-b288-d6aa35ee8e77" returned: 0 in 1.048s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:30 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5133e2d1-f741-4ba9-80a9-e4e92aebd5fd tempest-VolumesListTestJSON-1440128567 None] Lock "cinder-quobyte-5aceb24a-ecba-471f-b288-d6aa35ee8e77" released by "delete_volume" :: held 2.453s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:30 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-5133e2d1-f741-4ba9-80a9-e4e92aebd5fd tempest-VolumesListTestJSON-1440128567 None] Created reservations ['2aeeff80-414d-49b9-b244-0e37a1561d97', '9d1aefd3-aaf5-4776-928e-1b8efe1741df', '51f3c459-b33f-43cb-8a50-c3905623ce0e', '28a28559-12ac-436d-aa4b-c8d41ebbcde4'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:43:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5133e2d1-f741-4ba9-80a9-e4e92aebd5fd tempest-VolumesListTestJSON-1440128567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5133e2d1-f741-4ba9-80a9-e4e92aebd5fd tempest-VolumesListTestJSON-1440128567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5133e2d1-f741-4ba9-80a9-e4e92aebd5fd tempest-VolumesListTestJSON-1440128567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:43:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5133e2d1-f741-4ba9-80a9-e4e92aebd5fd tempest-VolumesListTestJSON-1440128567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:43:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5133e2d1-f741-4ba9-80a9-e4e92aebd5fd tempest-VolumesListTestJSON-1440128567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5133e2d1-f741-4ba9-80a9-e4e92aebd5fd tempest-VolumesListTestJSON-1440128567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:30 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:43:30 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:30 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-d9855fc2-f001-4e7a-8a8d-f127d8a99641 req-8b69bf82-204c-41f1-b3e6-b46e0616bc71 tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8684fee8-e72a-4f76-9c33-a0963b44e832" returned: 0 in 1.083s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-d9855fc2-f001-4e7a-8a8d-f127d8a99641 req-8b69bf82-204c-41f1-b3e6-b46e0616bc71 tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.106s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-d9855fc2-f001-4e7a-8a8d-f127d8a99641 req-8b69bf82-204c-41f1-b3e6-b46e0616bc71 tempest-TestInstancesWithCinderVolumes-760645170 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad', 'name': 'volume-8684fee8-e72a-4f76-9c33-a0963b44e832', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b76d42ee-8e2c-4352-956e-9e2d8e6c4b92', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:43:30 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-d9855fc2-f001-4e7a-8a8d-f127d8a99641 req-8b69bf82-204c-41f1-b3e6-b46e0616bc71 tempest-TestInstancesWithCinderVolumes-760645170 None] attachment_update completed successfully. Jul 08 14:43:30 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c4cf0805-f75f-4bd6-affb-5d882dcef056 tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179" returned: 0 in 1.054s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c4cf0805-f75f-4bd6-affb-5d882dcef056 tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:30 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179 Jul 08 14:43:30 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a6cf4a3a-b734-4323-bb16-94620d993b87 tempest-VolumesListTestJSON-1440128567 None] Acquiring lock "cinder-02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:31 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5133e2d1-f741-4ba9-80a9-e4e92aebd5fd tempest-VolumesListTestJSON-1440128567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.786s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:31 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-5133e2d1-f741-4ba9-80a9-e4e92aebd5fd tempest-VolumesListTestJSON-1440128567 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:43:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a6cf4a3a-b734-4323-bb16-94620d993b87 tempest-VolumesListTestJSON-1440128567 None] Lock "cinder-02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:31 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5133e2d1-f741-4ba9-80a9-e4e92aebd5fd tempest-VolumesListTestJSON-1440128567 None] Deleted volume successfully. Jul 08 14:43:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5133e2d1-f741-4ba9-80a9-e4e92aebd5fd tempest-VolumesListTestJSON-1440128567 None] Lock "cinder-5aceb24a-ecba-471f-b288-d6aa35ee8e77-delete_volume" released by "delete_volume" :: held 3.642s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a6cf4a3a-b734-4323-bb16-94620d993b87 tempest-VolumesListTestJSON-1440128567 None] Acquiring lock "cinder-quobyte-02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a6cf4a3a-b734-4323-bb16-94620d993b87 tempest-VolumesListTestJSON-1440128567 None] Lock "cinder-quobyte-02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:31 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f272b2-2910-404a-846f-c3057cd6fd8e]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6cf4a3a-b734-4323-bb16-94620d993b87 tempest-VolumesListTestJSON-1440128567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:31 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d Jul 08 14:43:31 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:31 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c4cf0805-f75f-4bd6-affb-5d882dcef056 tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8.ed7700ab-096d-408c-89fe-f1e22857b179" returned: 0 in 0.947s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c4cf0805-f75f-4bd6-affb-5d882dcef056 tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "cinder-quobyte-ed7700ab-096d-408c-89fe-f1e22857b179" released by "_delete_snapshot" :: held 4.574s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c4cf0805-f75f-4bd6-affb-5d882dcef056 tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "cinder-quobyte-b5299cff-6af2-4161-8632-17c76c86aba8" released by "delete_snapshot" :: held 4.612s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:31 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-c4cf0805-f75f-4bd6-affb-5d882dcef056 tempest-VolumesSnapshotListTestJSON-1941972136 None] Created reservations ['cd6d8e24-71d3-45d6-a34e-4a7a0b45cf62', '9c6789f1-2842-4a13-b3ad-c1b76af2a2b5', '3a084f9d-5ef4-4490-952c-88fac4b7f981', '449276f9-29ac-4814-abf8-0a90610686c5'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:43:32 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c4cf0805-f75f-4bd6-affb-5d882dcef056 tempest-VolumesSnapshotListTestJSON-1941972136 None] Delete snapshot completed successfully. Jul 08 14:43:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c4cf0805-f75f-4bd6-affb-5d882dcef056 tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "cinder-ed7700ab-096d-408c-89fe-f1e22857b179-delete_snapshot" released by "delete_snapshot" :: held 4.805s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:32 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6cf4a3a-b734-4323-bb16-94620d993b87 tempest-VolumesListTestJSON-1440128567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d" returned: 0 in 0.874s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6cf4a3a-b734-4323-bb16-94620d993b87 tempest-VolumesListTestJSON-1440128567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:32 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d Jul 08 14:43:32 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-69775bd7-fd8e-4e20-be5c-b2b6a8638894 tempest-VolumesSnapshotListTestJSON-1941972136 None] Acquiring lock "cinder-b5299cff-6af2-4161-8632-17c76c86aba8-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-69775bd7-fd8e-4e20-be5c-b2b6a8638894 tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "cinder-b5299cff-6af2-4161-8632-17c76c86aba8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-69775bd7-fd8e-4e20-be5c-b2b6a8638894 tempest-VolumesSnapshotListTestJSON-1941972136 None] Acquiring lock "cinder-quobyte-b5299cff-6af2-4161-8632-17c76c86aba8" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-69775bd7-fd8e-4e20-be5c-b2b6a8638894 tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "cinder-quobyte-b5299cff-6af2-4161-8632-17c76c86aba8" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:32 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[47826398-1427-464a-9bc0-873ec6c4737b]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-69775bd7-fd8e-4e20-be5c-b2b6a8638894 tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:32 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8 Jul 08 14:43:32 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:33 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6cf4a3a-b734-4323-bb16-94620d993b87 tempest-VolumesListTestJSON-1440128567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d" returned: 0 in 0.745s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:33 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a6cf4a3a-b734-4323-bb16-94620d993b87 tempest-VolumesListTestJSON-1440128567 None] Lock "cinder-quobyte-02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d" released by "delete_volume" :: held 1.694s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:33 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-a6cf4a3a-b734-4323-bb16-94620d993b87 tempest-VolumesListTestJSON-1440128567 None] Created reservations ['5226d343-f45a-47ee-b154-b1a65c81b892', '031411a4-9b6c-401f-9617-f2e70a3d42b0', '13c33688-04c7-40fa-8842-4db648b328b4', 'd9336611-df8c-406e-ac99-f6a4fdf44b16'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:43:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a6cf4a3a-b734-4323-bb16-94620d993b87 tempest-VolumesListTestJSON-1440128567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a6cf4a3a-b734-4323-bb16-94620d993b87 tempest-VolumesListTestJSON-1440128567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a6cf4a3a-b734-4323-bb16-94620d993b87 tempest-VolumesListTestJSON-1440128567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:43:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a6cf4a3a-b734-4323-bb16-94620d993b87 tempest-VolumesListTestJSON-1440128567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:43:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a6cf4a3a-b734-4323-bb16-94620d993b87 tempest-VolumesListTestJSON-1440128567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6cf4a3a-b734-4323-bb16-94620d993b87 tempest-VolumesListTestJSON-1440128567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:33 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:43:33 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:33 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-69775bd7-fd8e-4e20-be5c-b2b6a8638894 tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8" returned: 0 in 1.003s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-69775bd7-fd8e-4e20-be5c-b2b6a8638894 tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:33 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8 Jul 08 14:43:33 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:34 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a6cf4a3a-b734-4323-bb16-94620d993b87 tempest-VolumesListTestJSON-1440128567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.865s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:34 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-a6cf4a3a-b734-4323-bb16-94620d993b87 tempest-VolumesListTestJSON-1440128567 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:43:34 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a6cf4a3a-b734-4323-bb16-94620d993b87 tempest-VolumesListTestJSON-1440128567 None] Deleted volume successfully. Jul 08 14:43:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a6cf4a3a-b734-4323-bb16-94620d993b87 tempest-VolumesListTestJSON-1440128567 None] Lock "cinder-02f69548-7ee6-4cbc-8ef6-9d3d09d4e91d-delete_volume" released by "delete_volume" :: held 2.869s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:34 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-69775bd7-fd8e-4e20-be5c-b2b6a8638894 tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b5299cff-6af2-4161-8632-17c76c86aba8" returned: 0 in 0.843s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-69775bd7-fd8e-4e20-be5c-b2b6a8638894 tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "cinder-quobyte-b5299cff-6af2-4161-8632-17c76c86aba8" released by "delete_volume" :: held 1.923s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:34 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-69775bd7-fd8e-4e20-be5c-b2b6a8638894 tempest-VolumesSnapshotListTestJSON-1941972136 None] Created reservations ['484015e8-ab12-4faa-b6bc-cf67c926f404', 'a9ccc756-ec12-4835-b617-97cf975244c3', 'ded73b63-e001-42c2-8917-e38664023e5c', '9aa4e9cc-1f57-4c16-ac6d-97fa1304ae53'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:43:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-69775bd7-fd8e-4e20-be5c-b2b6a8638894 tempest-VolumesSnapshotListTestJSON-1941972136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-69775bd7-fd8e-4e20-be5c-b2b6a8638894 tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-69775bd7-fd8e-4e20-be5c-b2b6a8638894 tempest-VolumesSnapshotListTestJSON-1941972136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:43:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-69775bd7-fd8e-4e20-be5c-b2b6a8638894 tempest-VolumesSnapshotListTestJSON-1941972136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:43:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-69775bd7-fd8e-4e20-be5c-b2b6a8638894 tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-69775bd7-fd8e-4e20-be5c-b2b6a8638894 tempest-VolumesSnapshotListTestJSON-1941972136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:34 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:43:34 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:35 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-69775bd7-fd8e-4e20-be5c-b2b6a8638894 tempest-VolumesSnapshotListTestJSON-1941972136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.060s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:35 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-69775bd7-fd8e-4e20-be5c-b2b6a8638894 tempest-VolumesSnapshotListTestJSON-1941972136 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:43:35 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-69775bd7-fd8e-4e20-be5c-b2b6a8638894 tempest-VolumesSnapshotListTestJSON-1941972136 None] Deleted volume successfully. Jul 08 14:43:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-69775bd7-fd8e-4e20-be5c-b2b6a8638894 tempest-VolumesSnapshotListTestJSON-1941972136 None] Lock "cinder-b5299cff-6af2-4161-8632-17c76c86aba8-delete_volume" released by "delete_volume" :: held 3.260s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-d9433341-e016-4d19-aae5-a10537aa6589 req-d23bb273-d1d1-48da-b014-3903aa9d75a3 tempest-TestInstancesWithCinderVolumes-760645170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-d9433341-e016-4d19-aae5-a10537aa6589 req-d23bb273-d1d1-48da-b014-3903aa9d75a3 tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:38 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[80132cbc-777b-4f95-9c03-febc50f5c9cc]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-d9433341-e016-4d19-aae5-a10537aa6589 req-d23bb273-d1d1-48da-b014-3903aa9d75a3 tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b350800b-e279-41a4-a095-cecad630df11 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:38 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b350800b-e279-41a4-a095-cecad630df11 Jul 08 14:43:38 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:39 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-d9433341-e016-4d19-aae5-a10537aa6589 req-d23bb273-d1d1-48da-b014-3903aa9d75a3 tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b350800b-e279-41a4-a095-cecad630df11" returned: 0 in 1.057s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-d9433341-e016-4d19-aae5-a10537aa6589 req-d23bb273-d1d1-48da-b014-3903aa9d75a3 tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.082s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-d9433341-e016-4d19-aae5-a10537aa6589 req-d23bb273-d1d1-48da-b014-3903aa9d75a3 tempest-TestInstancesWithCinderVolumes-760645170 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad', 'name': 'volume-b350800b-e279-41a4-a095-cecad630df11', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '924e9270-fd1b-4040-b199-88af91c90fc5', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:43:40 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-d9433341-e016-4d19-aae5-a10537aa6589 req-d23bb273-d1d1-48da-b014-3903aa9d75a3 tempest-TestInstancesWithCinderVolumes-760645170 None] attachment_update completed successfully. Jul 08 14:43:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-d27fbec1-7c1a-44f9-9b16-7441d1145378 req-1966d77f-be46-43f5-8108-aa85027c179c tempest-TestInstancesWithCinderVolumes-760645170 None] Terminate volume connection completed successfully. Jul 08 14:43:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-d27fbec1-7c1a-44f9-9b16-7441d1145378 req-1966d77f-be46-43f5-8108-aa85027c179c tempest-TestInstancesWithCinderVolumes-760645170 None] Deleting attachment b76d42ee-8e2c-4352-956e-9e2d8e6c4b92. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:43:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-117a481b-6312-4a9f-83ed-5998ccb0772e tempest-TestInstancesWithCinderVolumes-760645170 None] Acquiring lock "cinder-8684fee8-e72a-4f76-9c33-a0963b44e832-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-117a481b-6312-4a9f-83ed-5998ccb0772e tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "cinder-8684fee8-e72a-4f76-9c33-a0963b44e832-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-117a481b-6312-4a9f-83ed-5998ccb0772e tempest-TestInstancesWithCinderVolumes-760645170 None] Acquiring lock "cinder-quobyte-8684fee8-e72a-4f76-9c33-a0963b44e832" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-117a481b-6312-4a9f-83ed-5998ccb0772e tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "cinder-quobyte-8684fee8-e72a-4f76-9c33-a0963b44e832" acquired by "delete_volume" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:52 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8601864d-d0b4-4bb9-947b-033e0dcd57dd]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-117a481b-6312-4a9f-83ed-5998ccb0772e tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8684fee8-e72a-4f76-9c33-a0963b44e832 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:52 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8684fee8-e72a-4f76-9c33-a0963b44e832 Jul 08 14:43:52 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:53 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-117a481b-6312-4a9f-83ed-5998ccb0772e tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8684fee8-e72a-4f76-9c33-a0963b44e832" returned: 0 in 1.080s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-117a481b-6312-4a9f-83ed-5998ccb0772e tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8684fee8-e72a-4f76-9c33-a0963b44e832 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:53 devstack sudo[100839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8684fee8-e72a-4f76-9c33-a0963b44e832 Jul 08 14:43:53 devstack sudo[100839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Flow 'volume_create_manager' (02bfe925-adf7-42a3-8b1a-913453f83e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffbe2963-d273-4f00-ae87-88cc30b49a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffbe2963-d273-4f00-ae87-88cc30b49a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1590998099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c1d615a-6a87-417b-83a1-bb48672cd129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b11114dce564cf88c7b7a9554b7a7af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:43:53Z,use_quota=True,user_id='08689ea63e384a7fa9b226b114081132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97886a08-7748-4f9e-a7b9-19b54b2dae2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97886a08-7748-4f9e-a7b9-19b54b2dae2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2dc1c9-844b-48d8-98bd-bf2dc15db3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e2dc1c9-844b-48d8-98bd-bf2dc15db3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c1d615a-6a87-417b-83a1-bb48672cd129', 'volume_name': 'volume-8c1d615a-6a87-417b-83a1-bb48672cd129', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0635cc5b-a301-4e2b-95cd-ee971d5d4048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0635cc5b-a301-4e2b-95cd-ee971d5d4048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064c0e27-4d84-4a5b-8a03-a72bc4e2efb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:53 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Volume 8c1d615a-6a87-417b-83a1-bb48672cd129: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c1d615a-6a87-417b-83a1-bb48672cd129', 'volume_size': 1} Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1590998099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c1d615a-6a87-417b-83a1-bb48672cd129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b11114dce564cf88c7b7a9554b7a7af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:43:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:43:53Z,use_quota=True,user_id='08689ea63e384a7fa9b226b114081132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Creating volume 8c1d615a-6a87-417b-83a1-bb48672cd129 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:43:53 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:43:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:53 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129 1073741824 Jul 08 14:43:53 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:54 devstack sudo[100839]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-117a481b-6312-4a9f-83ed-5998ccb0772e tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8684fee8-e72a-4f76-9c33-a0963b44e832" returned: 0 in 0.989s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-117a481b-6312-4a9f-83ed-5998ccb0772e tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "cinder-quobyte-8684fee8-e72a-4f76-9c33-a0963b44e832" released by "delete_volume" :: held 2.144s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:54 devstack cinder-volume[87240]: WARNING cinder.quota [None req-117a481b-6312-4a9f-83ed-5998ccb0772e tempest-TestInstancesWithCinderVolumes-760645170 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1319448633-251277726 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1319448633-251277726, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:43:54 devstack cinder-volume[87240]: WARNING cinder.quota [None req-117a481b-6312-4a9f-83ed-5998ccb0772e tempest-TestInstancesWithCinderVolumes-760645170 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1319448633-251277726 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1319448633-251277726, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:43:54 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-117a481b-6312-4a9f-83ed-5998ccb0772e tempest-TestInstancesWithCinderVolumes-760645170 None] Created reservations ['56b8a3e6-cdb5-412d-a7de-55c02c1dc995', '6b24c8e3-a179-495e-9fb6-e0cccf1a67e0', 'fca6a353-e347-4e92-841a-cdb5b121503b', '1ec7b856-7f55-4137-8240-9bfefd61ad81'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:43:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-117a481b-6312-4a9f-83ed-5998ccb0772e tempest-TestInstancesWithCinderVolumes-760645170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-117a481b-6312-4a9f-83ed-5998ccb0772e tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-117a481b-6312-4a9f-83ed-5998ccb0772e tempest-TestInstancesWithCinderVolumes-760645170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:43:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-117a481b-6312-4a9f-83ed-5998ccb0772e tempest-TestInstancesWithCinderVolumes-760645170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:43:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-117a481b-6312-4a9f-83ed-5998ccb0772e tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-117a481b-6312-4a9f-83ed-5998ccb0772e tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:54 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:43:54 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:55 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129 1073741824" returned: 0 in 1.265s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:55 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129 Jul 08 14:43:55 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:55 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-117a481b-6312-4a9f-83ed-5998ccb0772e tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.842s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:55 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-117a481b-6312-4a9f-83ed-5998ccb0772e tempest-TestInstancesWithCinderVolumes-760645170 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:43:55 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-117a481b-6312-4a9f-83ed-5998ccb0772e tempest-TestInstancesWithCinderVolumes-760645170 None] Deleted volume successfully. Jul 08 14:43:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-117a481b-6312-4a9f-83ed-5998ccb0772e tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "cinder-8684fee8-e72a-4f76-9c33-a0963b44e832-delete_volume" released by "delete_volume" :: held 3.336s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:43:55 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129" returned: 0 in 0.767s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] <== create_volume: return (2095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:43:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (064c0e27-4d84-4a5b-8a03-a72bc4e2efb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c1d615a-6a87-417b-83a1-bb48672cd129', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec51f3e-d29a-4c95-bf19-450d25310257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:43:55 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Volume volume-8c1d615a-6a87-417b-83a1-bb48672cd129 (8c1d615a-6a87-417b-83a1-bb48672cd129): created successfully Jul 08 14:43:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec51f3e-d29a-4c95-bf19-450d25310257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:43:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Flow 'volume_create_manager' (02bfe925-adf7-42a3-8b1a-913453f83e69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:43:55 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-48317aec-9b3c-4a38-b19d-ff43109fa429 tempest-VolumesSnapshotTestJSON-1895351254 None] Created volume successfully. Jul 08 14:43:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-06d757e9-b843-437b-9cdf-f06f421cd636 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-06d757e9-b843-437b-9cdf-f06f421cd636 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-06d757e9-b843-437b-9cdf-f06f421cd636 tempest-VolumesSnapshotTestJSON-1895351254 None] Creating offline snapshot 2cfddada-3361-4f94-9554-2395db03c077 of volume 8c1d615a-6a87-417b-83a1-bb48672cd129 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:43:57 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6dee1b-4afc-47df-aa7e-7be5139fadc2]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-06d757e9-b843-437b-9cdf-f06f421cd636 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:57 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129 Jul 08 14:43:57 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:57 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-0ce877e1-159a-44f7-8a6e-53fc0a4a66b1 req-fc0dfee3-ea6f-4528-ad3f-66d6df8dead1 tempest-TestInstancesWithCinderVolumes-760645170 None] Terminate volume connection completed successfully. Jul 08 14:43:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-0ce877e1-159a-44f7-8a6e-53fc0a4a66b1 req-fc0dfee3-ea6f-4528-ad3f-66d6df8dead1 tempest-TestInstancesWithCinderVolumes-760645170 None] Deleting attachment 924e9270-fd1b-4040-b199-88af91c90fc5. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:43:57 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-06d757e9-b843-437b-9cdf-f06f421cd636 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129" returned: 0 in 0.943s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-06d757e9-b843-437b-9cdf-f06f421cd636 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.2cfddada-3361-4f94-9554-2395db03c077 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:58 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.2cfddada-3361-4f94-9554-2395db03c077 1G Jul 08 14:43:58 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:58 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-06d757e9-b843-437b-9cdf-f06f421cd636 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.2cfddada-3361-4f94-9554-2395db03c077 1G" returned: 0 in 0.901s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-06d757e9-b843-437b-9cdf-f06f421cd636 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c1d615a-6a87-417b-83a1-bb48672cd129 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.2cfddada-3361-4f94-9554-2395db03c077 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:58 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c1d615a-6a87-417b-83a1-bb48672cd129 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.2cfddada-3361-4f94-9554-2395db03c077 Jul 08 14:43:58 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:43:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:43:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:43:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:43:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:43:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:43:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:59 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:43:59 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:43:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-97e8fea5-80ae-40e9-a72e-9b097c372153 tempest-TestInstancesWithCinderVolumes-760645170 None] Acquiring lock "cinder-b350800b-e279-41a4-a095-cecad630df11-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-97e8fea5-80ae-40e9-a72e-9b097c372153 tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "cinder-b350800b-e279-41a4-a095-cecad630df11-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-97e8fea5-80ae-40e9-a72e-9b097c372153 tempest-TestInstancesWithCinderVolumes-760645170 None] Acquiring lock "cinder-quobyte-b350800b-e279-41a4-a095-cecad630df11" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:43:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-97e8fea5-80ae-40e9-a72e-9b097c372153 tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "cinder-quobyte-b350800b-e279-41a4-a095-cecad630df11" acquired by "delete_volume" :: waited 0.037s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:43:59 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Jul 08 14:43:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-06d757e9-b843-437b-9cdf-f06f421cd636 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c1d615a-6a87-417b-83a1-bb48672cd129 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.2cfddada-3361-4f94-9554-2395db03c077" returned: 0 in 0.972s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:43:59 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-06d757e9-b843-437b-9cdf-f06f421cd636 tempest-VolumesSnapshotTestJSON-1895351254 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.2cfddada-3361-4f94-9554-2395db03c077 is being set with open permissions: ugo+rw Jul 08 14:43:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-06d757e9-b843-437b-9cdf-f06f421cd636 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.2cfddada-3361-4f94-9554-2395db03c077 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:59 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1c58ec-170d-42b7-aca9-f894997bdf45]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:43:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-97e8fea5-80ae-40e9-a72e-9b097c372153 tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b350800b-e279-41a4-a095-cecad630df11 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:43:59 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.2cfddada-3361-4f94-9554-2395db03c077 Jul 08 14:43:59 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:00 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b350800b-e279-41a4-a095-cecad630df11 Jul 08 14:44:00 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:00 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.163s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:44:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:44:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:44:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:44:01 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-06d757e9-b843-437b-9cdf-f06f421cd636 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.2cfddada-3361-4f94-9554-2395db03c077" returned: 0 in 1.214s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-06d757e9-b843-437b-9cdf-f06f421cd636 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:01 devstack sudo[100909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.info Jul 08 14:44:01 devstack sudo[100909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:01 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-97e8fea5-80ae-40e9-a72e-9b097c372153 tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b350800b-e279-41a4-a095-cecad630df11" returned: 0 in 1.364s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-97e8fea5-80ae-40e9-a72e-9b097c372153 tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b350800b-e279-41a4-a095-cecad630df11 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:01 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b350800b-e279-41a4-a095-cecad630df11 Jul 08 14:44:01 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:02 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-97e8fea5-80ae-40e9-a72e-9b097c372153 tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b350800b-e279-41a4-a095-cecad630df11" returned: 0 in 0.997s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-97e8fea5-80ae-40e9-a72e-9b097c372153 tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "cinder-quobyte-b350800b-e279-41a4-a095-cecad630df11" released by "delete_volume" :: held 2.439s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:02 devstack cinder-volume[87240]: WARNING cinder.quota [None req-97e8fea5-80ae-40e9-a72e-9b097c372153 tempest-TestInstancesWithCinderVolumes-760645170 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-110542912-1703177172 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-110542912-1703177172, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:44:02 devstack cinder-volume[87240]: WARNING cinder.quota [None req-97e8fea5-80ae-40e9-a72e-9b097c372153 tempest-TestInstancesWithCinderVolumes-760645170 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-110542912-1703177172 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-110542912-1703177172, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:44:02 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-97e8fea5-80ae-40e9-a72e-9b097c372153 tempest-TestInstancesWithCinderVolumes-760645170 None] Created reservations ['caf1a704-56f0-4322-8a08-ec8292a7f278', 'b9a5cc7a-69af-467e-a0cb-504062722def', 'ada52834-2307-40d4-8f12-9d5913039d7a', 'd2728a2d-5961-4b62-8c00-aef5d4572f14'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:44:02 devstack sudo[100909]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-06d757e9-b843-437b-9cdf-f06f421cd636 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.info" returned: 0 in 1.291s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:02 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-06d757e9-b843-437b-9cdf-f06f421cd636 tempest-VolumesSnapshotTestJSON-1895351254 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.info is being set with open permissions: ugo+rw Jul 08 14:44:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-06d757e9-b843-437b-9cdf-f06f421cd636 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:02 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.info Jul 08 14:44:02 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-97e8fea5-80ae-40e9-a72e-9b097c372153 tempest-TestInstancesWithCinderVolumes-760645170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-97e8fea5-80ae-40e9-a72e-9b097c372153 tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-97e8fea5-80ae-40e9-a72e-9b097c372153 tempest-TestInstancesWithCinderVolumes-760645170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:44:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-97e8fea5-80ae-40e9-a72e-9b097c372153 tempest-TestInstancesWithCinderVolumes-760645170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:44:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-97e8fea5-80ae-40e9-a72e-9b097c372153 tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-97e8fea5-80ae-40e9-a72e-9b097c372153 tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:02 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:44:02 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:03 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-06d757e9-b843-437b-9cdf-f06f421cd636 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.info" returned: 0 in 0.888s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-06d757e9-b843-437b-9cdf-f06f421cd636 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.353s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:03 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-06d757e9-b843-437b-9cdf-f06f421cd636 tempest-VolumesSnapshotTestJSON-1895351254 None] Create snapshot completed successfully Jul 08 14:44:03 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-97e8fea5-80ae-40e9-a72e-9b097c372153 tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.062s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:03 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-97e8fea5-80ae-40e9-a72e-9b097c372153 tempest-TestInstancesWithCinderVolumes-760645170 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:44:03 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-97e8fea5-80ae-40e9-a72e-9b097c372153 tempest-TestInstancesWithCinderVolumes-760645170 None] Deleted volume successfully. Jul 08 14:44:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-97e8fea5-80ae-40e9-a72e-9b097c372153 tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "cinder-b350800b-e279-41a4-a095-cecad630df11-delete_volume" released by "delete_volume" :: held 3.949s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-26d16b03-0126-478c-ac11-2ad990eb91fe tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "cinder-2cfddada-3361-4f94-9554-2395db03c077-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-26d16b03-0126-478c-ac11-2ad990eb91fe tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-2cfddada-3361-4f94-9554-2395db03c077-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-26d16b03-0126-478c-ac11-2ad990eb91fe tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "cinder-quobyte-8c1d615a-6a87-417b-83a1-bb48672cd129" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-26d16b03-0126-478c-ac11-2ad990eb91fe tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-8c1d615a-6a87-417b-83a1-bb48672cd129" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-26d16b03-0126-478c-ac11-2ad990eb91fe tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "cinder-quobyte-2cfddada-3361-4f94-9554-2395db03c077" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-26d16b03-0126-478c-ac11-2ad990eb91fe tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-2cfddada-3361-4f94-9554-2395db03c077" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-26d16b03-0126-478c-ac11-2ad990eb91fe tempest-VolumesSnapshotTestJSON-1895351254 None] Deleting offline snapshot 2cfddada-3361-4f94-9554-2395db03c077 of volume 8c1d615a-6a87-417b-83a1-bb48672cd129 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:44:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-26d16b03-0126-478c-ac11-2ad990eb91fe tempest-VolumesSnapshotTestJSON-1895351254 None] snapshot_file for this snap is: volume-8c1d615a-6a87-417b-83a1-bb48672cd129.2cfddada-3361-4f94-9554-2395db03c077 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:44:04 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[104d16e0-554b-4d9e-a95c-7995b61939a3]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26d16b03-0126-478c-ac11-2ad990eb91fe tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.2cfddada-3361-4f94-9554-2395db03c077 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:04 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.2cfddada-3361-4f94-9554-2395db03c077 Jul 08 14:44:04 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:05 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26d16b03-0126-478c-ac11-2ad990eb91fe tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.2cfddada-3361-4f94-9554-2395db03c077" returned: 0 in 1.016s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-26d16b03-0126-478c-ac11-2ad990eb91fe tempest-VolumesSnapshotTestJSON-1895351254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c1d615a-6a87-417b-83a1-bb48672cd129(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:44:05 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[24019e38-7c7f-462d-a360-32c0f6de70be]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26d16b03-0126-478c-ac11-2ad990eb91fe tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:06 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129 Jul 08 14:44:06 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:07 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26d16b03-0126-478c-ac11-2ad990eb91fe tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129" returned: 0 in 1.152s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26d16b03-0126-478c-ac11-2ad990eb91fe tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.2cfddada-3361-4f94-9554-2395db03c077 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:07 devstack sudo[100959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.2cfddada-3361-4f94-9554-2395db03c077 Jul 08 14:44:07 devstack sudo[100959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:08 devstack sudo[100959]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26d16b03-0126-478c-ac11-2ad990eb91fe tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.2cfddada-3361-4f94-9554-2395db03c077" returned: 0 in 1.054s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26d16b03-0126-478c-ac11-2ad990eb91fe tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.2cfddada-3361-4f94-9554-2395db03c077 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:08 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.2cfddada-3361-4f94-9554-2395db03c077 Jul 08 14:44:08 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:09 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26d16b03-0126-478c-ac11-2ad990eb91fe tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129.2cfddada-3361-4f94-9554-2395db03c077" returned: 0 in 0.899s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=72,cinder:SELECT=78,cinder:DELETE=8,cinder:INSERT=22 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-26d16b03-0126-478c-ac11-2ad990eb91fe tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-2cfddada-3361-4f94-9554-2395db03c077" released by "_delete_snapshot" :: held 4.303s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-26d16b03-0126-478c-ac11-2ad990eb91fe tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-8c1d615a-6a87-417b-83a1-bb48672cd129" released by "delete_snapshot" :: held 4.345s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-26d16b03-0126-478c-ac11-2ad990eb91fe tempest-VolumesSnapshotTestJSON-1895351254 None] Created reservations ['c74542c6-0597-4a68-800b-08939412c2ce', '2255b023-c6df-4bfd-96a9-4f862adbb88d', 'e03eefee-3ad2-42bd-a6b9-0a18ef081791', '24340aca-974d-4653-b933-72215d8d8d73'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:44:09 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-26d16b03-0126-478c-ac11-2ad990eb91fe tempest-VolumesSnapshotTestJSON-1895351254 None] Delete snapshot completed successfully. Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-26d16b03-0126-478c-ac11-2ad990eb91fe tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-2cfddada-3361-4f94-9554-2395db03c077-delete_snapshot" released by "delete_snapshot" :: held 4.613s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Flow 'volume_create_manager' (1dabe979-9c6d-4933-b3ea-a25d2a22ceaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99bc1656-3d85-42e6-ae17-4a0961717081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99bc1656-3d85-42e6-ae17-4a0961717081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-369976528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b8381bf-6f06-4767-9e19-19816905aa00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34400d5922034a96a7511d60e11db63a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:44:09Z,use_quota=True,user_id='14aeea83e0434dcebadea9a6724a8ae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3433634f-8084-4627-b27b-ca82fc87ed6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3433634f-8084-4627-b27b-ca82fc87ed6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac211c3-4fc9-440e-ae39-371c6a9cba03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eac211c3-4fc9-440e-ae39-371c6a9cba03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b8381bf-6f06-4767-9e19-19816905aa00', 'volume_name': 'volume-8b8381bf-6f06-4767-9e19-19816905aa00', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a57bb09-d482-460a-ad0c-f4115cb7e18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a57bb09-d482-460a-ad0c-f4115cb7e18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9e04e7-d27a-41c0-b4cd-056fb0561099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:09 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Volume 8b8381bf-6f06-4767-9e19-19816905aa00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b8381bf-6f06-4767-9e19-19816905aa00', 'volume_size': 1} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-369976528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b8381bf-6f06-4767-9e19-19816905aa00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34400d5922034a96a7511d60e11db63a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:44:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:44:09Z,use_quota=True,user_id='14aeea83e0434dcebadea9a6724a8ae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Creating volume 8b8381bf-6f06-4767-9e19-19816905aa00 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:44:09 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8b8381bf-6f06-4767-9e19-19816905aa00 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:09 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8b8381bf-6f06-4767-9e19-19816905aa00 1073741824 Jul 08 14:44:09 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:09 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-9084cb8d-c8c6-454e-aac3-ec45c29971d2 req-3a440677-71ac-4bbc-a261-30a9cb6e881b tempest-TestInstancesWithCinderVolumes-760645170 None] Terminate volume connection completed successfully. Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-9084cb8d-c8c6-454e-aac3-ec45c29971d2 req-3a440677-71ac-4bbc-a261-30a9cb6e881b tempest-TestInstancesWithCinderVolumes-760645170 None] Deleting attachment 11604704-fe75-42db-8fcc-da53f7323fca. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Flow 'volume_create_manager' (8953457f-d362-411a-9123-c1934a2be875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5d7128-9cfa-4b1e-9909-f1635dd5682b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5d7128-9cfa-4b1e-9909-f1635dd5682b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-169146841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df2db87-25a7-4fde-ab62-9f989c59ad48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34400d5922034a96a7511d60e11db63a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:44:10Z,use_quota=True,user_id='14aeea83e0434dcebadea9a6724a8ae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb42e52-e09e-49f5-9c33-7ab91e65bb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb42e52-e09e-49f5-9c33-7ab91e65bb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3742e4-36c4-4afc-92b6-8c044f227d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3742e4-36c4-4afc-92b6-8c044f227d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4df2db87-25a7-4fde-ab62-9f989c59ad48', 'volume_name': 'volume-4df2db87-25a7-4fde-ab62-9f989c59ad48', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd4efa3-c594-406b-8844-a4df899d8945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bd4efa3-c594-406b-8844-a4df899d8945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e974777-5764-460f-bd61-6cd715d83f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:09 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Volume 4df2db87-25a7-4fde-ab62-9f989c59ad48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4df2db87-25a7-4fde-ab62-9f989c59ad48', 'volume_size': 1} Jul 08 14:44:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:10 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8b8381bf-6f06-4767-9e19-19816905aa00 1073741824" returned: 0 in 1.064s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:10 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=90,cinder:UPDATE=105,cinder:INSERT=22,cinder:DELETE=5 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:44:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8b8381bf-6f06-4767-9e19-19816905aa00 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:10 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8b8381bf-6f06-4767-9e19-19816905aa00 Jul 08 14:44:10 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:10 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:44:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Flow 'volume_create_manager' (ecc6c25a-86bb-417c-83fe-8641495534ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:44:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a947b4e-0b26-47ab-b3ea-88d989a0f249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a947b4e-0b26-47ab-b3ea-88d989a0f249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-118458921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54dcf753-3944-4fea-950c-9a1e28664c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b11114dce564cf88c7b7a9554b7a7af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:44:11Z,use_quota=True,user_id='08689ea63e384a7fa9b226b114081132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0453627-9795-41a9-ad32-9d103a180e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0453627-9795-41a9-ad32-9d103a180e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8829cb33-eba3-4eb5-8720-1822cca16125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8829cb33-eba3-4eb5-8720-1822cca16125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54dcf753-3944-4fea-950c-9a1e28664c98', 'volume_name': 'volume-54dcf753-3944-4fea-950c-9a1e28664c98', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350860b5-b573-4114-b3c3-44b2e4749a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (350860b5-b573-4114-b3c3-44b2e4749a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e783f139-68d0-4638-aa5a-8baac1c27d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:11 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Volume 54dcf753-3944-4fea-950c-9a1e28664c98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54dcf753-3944-4fea-950c-9a1e28664c98', 'volume_size': 1} Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:11 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8b8381bf-6f06-4767-9e19-19816905aa00" returned: 0 in 0.774s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] <== create_volume: return (1935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.938s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.449s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:44:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-169146841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df2db87-25a7-4fde-ab62-9f989c59ad48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34400d5922034a96a7511d60e11db63a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:44:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:44:10Z,use_quota=True,user_id='14aeea83e0434dcebadea9a6724a8ae1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Creating volume 4df2db87-25a7-4fde-ab62-9f989c59ad48 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:44:11 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4df2db87-25a7-4fde-ab62-9f989c59ad48 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9e04e7-d27a-41c0-b4cd-056fb0561099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b8381bf-6f06-4767-9e19-19816905aa00', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4cf3917-c8aa-461d-8410-b12e6e1c9148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:11 devstack sudo[100981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4df2db87-25a7-4fde-ab62-9f989c59ad48 1073741824 Jul 08 14:44:11 devstack sudo[100981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:11 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Volume volume-8b8381bf-6f06-4767-9e19-19816905aa00 (8b8381bf-6f06-4767-9e19-19816905aa00): created successfully Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4cf3917-c8aa-461d-8410-b12e6e1c9148) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Flow 'volume_create_manager' (1dabe979-9c6d-4933-b3ea-a25d2a22ceaf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:44:11 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-81da4260-9560-47cf-9208-8c3c95e8dde8 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Created volume successfully. Jul 08 14:44:12 devstack sudo[100981]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4df2db87-25a7-4fde-ab62-9f989c59ad48 1073741824" returned: 0 in 0.986s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4df2db87-25a7-4fde-ab62-9f989c59ad48 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:12 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4df2db87-25a7-4fde-ab62-9f989c59ad48 Jul 08 14:44:12 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] Acquiring lock "cinder-70d53b1a-841b-4e11-ae40-a906ca1cd0d4-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "cinder-70d53b1a-841b-4e11-ae40-a906ca1cd0d4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] Acquiring lock "cinder-quobyte-70d53b1a-841b-4e11-ae40-a906ca1cd0d4" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "cinder-quobyte-70d53b1a-841b-4e11-ae40-a906ca1cd0d4" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:13 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a95351-9589-4573-a913-b6394d5b8eba]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:13 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4df2db87-25a7-4fde-ab62-9f989c59ad48" returned: 0 in 0.790s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:44:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.214s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:44:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-118458921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54dcf753-3944-4fea-950c-9a1e28664c98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b11114dce564cf88c7b7a9554b7a7af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:44:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:44:11Z,use_quota=True,user_id='08689ea63e384a7fa9b226b114081132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:44:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Creating volume 54dcf753-3944-4fea-950c-9a1e28664c98 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:44:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:44:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:44:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:44:13 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:44:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:13 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98 1073741824 Jul 08 14:44:13 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e974777-5764-460f-bd61-6cd715d83f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4df2db87-25a7-4fde-ab62-9f989c59ad48', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:13 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:13 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a31fd92-2b82-4f09-887f-38963844271b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:13 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Volume volume-4df2db87-25a7-4fde-ab62-9f989c59ad48 (4df2db87-25a7-4fde-ab62-9f989c59ad48): created successfully Jul 08 14:44:13 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a31fd92-2b82-4f09-887f-38963844271b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:13 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Flow 'volume_create_manager' (8953457f-d362-411a-9123-c1934a2be875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:44:13 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 Jul 08 14:44:13 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:13 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a0ec13bb-e0db-428b-abc4-5434d3cfee7d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Created volume successfully. Jul 08 14:44:14 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4" returned: 0 in 0.894s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:14 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98 1073741824" returned: 0 in 0.986s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:14 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 Jul 08 14:44:14 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:14 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98 Jul 08 14:44:14 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:15 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4" returned: 1 in 0.938s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:44:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:15 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98" returned: 0 in 0.775s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:44:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:15 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4 Jul 08 14:44:15 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e783f139-68d0-4638-aa5a-8baac1c27d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54dcf753-3944-4fea-950c-9a1e28664c98', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec754b0-3ca9-4f02-9b1f-f01e6e41c068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:15 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Volume volume-54dcf753-3944-4fea-950c-9a1e28664c98 (54dcf753-3944-4fea-950c-9a1e28664c98): created successfully Jul 08 14:44:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec754b0-3ca9-4f02-9b1f-f01e6e41c068) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Flow 'volume_create_manager' (ecc6c25a-86bb-417c-83fe-8641495534ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:44:15 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8d813457-8c77-4bdb-8cb7-daf3b550fbe2 tempest-VolumesSnapshotTestJSON-1895351254 None] Created volume successfully. Jul 08 14:44:15 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-70d53b1a-841b-4e11-ae40-a906ca1cd0d4" returned: 0 in 0.708s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "cinder-quobyte-70d53b1a-841b-4e11-ae40-a906ca1cd0d4" released by "delete_volume" :: held 2.622s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:15 devstack cinder-volume[87240]: WARNING cinder.quota [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1833399337-1927609851 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1833399337-1927609851, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:44:15 devstack cinder-volume[87240]: WARNING cinder.quota [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1833399337-1927609851 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1833399337-1927609851, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:44:15 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] Created reservations ['d7aa571d-b4d3-4a04-bd42-18e26c93e16c', '60ac2434-9ec7-4766-a784-9f55ba873339', '0f727e6c-c4eb-47aa-96f3-d8343f8472a1', '6837e96c-b1ca-484c-91c0-0e7faa0b3c45'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:44:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:44:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:44:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:15 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:44:15 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d6d087d9-6454-4f87-89cf-1c866f9a0c43 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d6d087d9-6454-4f87-89cf-1c866f9a0c43 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d6d087d9-6454-4f87-89cf-1c866f9a0c43 tempest-VolumesSnapshotTestJSON-1895351254 None] Creating offline snapshot 19f03362-0cfd-4d51-8f3f-751bdef0257e of volume 54dcf753-3944-4fea-950c-9a1e28664c98 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:44:16 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e93312-a1a9-473c-b6bf-12137c653104]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d6d087d9-6454-4f87-89cf-1c866f9a0c43 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:16 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98 Jul 08 14:44:16 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:16 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.755s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:16 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:44:16 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] Deleted volume successfully. Jul 08 14:44:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-91996a7f-4887-4c5b-8034-c06a45b88aa9 tempest-TestInstancesWithCinderVolumes-760645170 None] Lock "cinder-70d53b1a-841b-4e11-ae40-a906ca1cd0d4-delete_volume" released by "delete_volume" :: held 3.619s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:17 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d6d087d9-6454-4f87-89cf-1c866f9a0c43 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98" returned: 0 in 0.877s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d6d087d9-6454-4f87-89cf-1c866f9a0c43 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.19f03362-0cfd-4d51-8f3f-751bdef0257e 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:17 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.19f03362-0cfd-4d51-8f3f-751bdef0257e 1G Jul 08 14:44:17 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:18 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d6d087d9-6454-4f87-89cf-1c866f9a0c43 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.19f03362-0cfd-4d51-8f3f-751bdef0257e 1G" returned: 0 in 1.083s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d6d087d9-6454-4f87-89cf-1c866f9a0c43 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54dcf753-3944-4fea-950c-9a1e28664c98 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.19f03362-0cfd-4d51-8f3f-751bdef0257e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:18 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54dcf753-3944-4fea-950c-9a1e28664c98 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.19f03362-0cfd-4d51-8f3f-751bdef0257e Jul 08 14:44:18 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:19 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d6d087d9-6454-4f87-89cf-1c866f9a0c43 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54dcf753-3944-4fea-950c-9a1e28664c98 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.19f03362-0cfd-4d51-8f3f-751bdef0257e" returned: 0 in 0.942s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:19 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-d6d087d9-6454-4f87-89cf-1c866f9a0c43 tempest-VolumesSnapshotTestJSON-1895351254 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.19f03362-0cfd-4d51-8f3f-751bdef0257e is being set with open permissions: ugo+rw Jul 08 14:44:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d6d087d9-6454-4f87-89cf-1c866f9a0c43 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.19f03362-0cfd-4d51-8f3f-751bdef0257e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:19 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.19f03362-0cfd-4d51-8f3f-751bdef0257e Jul 08 14:44:19 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:20 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d6d087d9-6454-4f87-89cf-1c866f9a0c43 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.19f03362-0cfd-4d51-8f3f-751bdef0257e" returned: 0 in 0.872s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d6d087d9-6454-4f87-89cf-1c866f9a0c43 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:20 devstack sudo[101037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.info Jul 08 14:44:20 devstack sudo[101037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:21 devstack sudo[101037]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d6d087d9-6454-4f87-89cf-1c866f9a0c43 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.info" returned: 0 in 0.927s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:21 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-d6d087d9-6454-4f87-89cf-1c866f9a0c43 tempest-VolumesSnapshotTestJSON-1895351254 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.info is being set with open permissions: ugo+rw Jul 08 14:44:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d6d087d9-6454-4f87-89cf-1c866f9a0c43 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:21 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.info Jul 08 14:44:21 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:21 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d6d087d9-6454-4f87-89cf-1c866f9a0c43 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.info" returned: 0 in 0.716s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d6d087d9-6454-4f87-89cf-1c866f9a0c43 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.583s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:22 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d6d087d9-6454-4f87-89cf-1c866f9a0c43 tempest-VolumesSnapshotTestJSON-1895351254 None] Create snapshot completed successfully Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Flow 'volume_create_manager' (8228f706-460a-4c64-ac5f-8c795c3ac158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5883edc-8fab-40f7-975b-47fac147eceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5883edc-8fab-40f7-975b-47fac147eceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:44:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-90163322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a10532b6-3802-4226-a914-10d671a18695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b11114dce564cf88c7b7a9554b7a7af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:44:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=19f03362-0cfd-4d51-8f3f-751bdef0257e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:44:23Z,use_quota=True,user_id='08689ea63e384a7fa9b226b114081132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b733b7d8-64c7-4bff-b136-0c1889a16986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b733b7d8-64c7-4bff-b136-0c1889a16986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebab356b-880b-4e24-ac3c-b343cce78a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebab356b-880b-4e24-ac3c-b343cce78a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a10532b6-3802-4226-a914-10d671a18695', 'volume_name': 'volume-a10532b6-3802-4226-a914-10d671a18695', 'volume_size': 2, 'snapshot_id': '19f03362-0cfd-4d51-8f3f-751bdef0257e'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91a76c67-dea7-43c1-aa9f-2509d584dc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91a76c67-dea7-43c1-aa9f-2509d584dc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6ec588-ed1d-44aa-8da7-b82a9c8c653b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:23 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Volume a10532b6-3802-4226-a914-10d671a18695: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a10532b6-3802-4226-a914-10d671a18695', 'volume_size': 2, 'snapshot_id': '19f03362-0cfd-4d51-8f3f-751bdef0257e'} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "cinder-quobyte-19f03362-0cfd-4d51-8f3f-751bdef0257e-a10532b6-3802-4226-a914-10d671a18695" by "_create_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-19f03362-0cfd-4d51-8f3f-751bdef0257e-a10532b6-3802-4226-a914-10d671a18695" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Creating volume a10532b6-3802-4226-a914-10d671a18695 from snapshot 19f03362-0cfd-4d51-8f3f-751bdef0257e {{(pid=87240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "cinder-quobyte-a10532b6-3802-4226-a914-10d671a18695" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-a10532b6-3802-4226-a914-10d671a18695" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] snapshot: 19f03362-0cfd-4d51-8f3f-751bdef0257e, volume: a10532b6-3802-4226-a914-10d671a18695, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[651feeec-9bd6-49bf-9c95-d2ae69dc3311]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.19f03362-0cfd-4d51-8f3f-751bdef0257e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:23 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.19f03362-0cfd-4d51-8f3f-751bdef0257e Jul 08 14:44:23 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:24 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.19f03362-0cfd-4d51-8f3f-751bdef0257e" returned: 0 in 0.999s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54dcf753-3944-4fea-950c-9a1e28664c98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:44:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98 {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:44:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:44:24 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[90af4873-3ef8-404a-867f-d85bc0e15a37]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:24 devstack sudo[101098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98 Jul 08 14:44:24 devstack sudo[101098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:25 devstack sudo[101098]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98" returned: 0 in 1.067s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:25 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Path /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a10532b6-3802-4226-a914-10d671a18695 not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:44:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a10532b6-3802-4226-a914-10d671a18695 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:25 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a10532b6-3802-4226-a914-10d671a18695 Jul 08 14:44:25 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:33 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a10532b6-3802-4226-a914-10d671a18695" returned: 0 in 7.670s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:33 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9570fc74-a9a6-4c62-8005-0d812c7595f7]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:33 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=19,cinder:DELETE=5,cinder:SELECT=11,cinder:INSERT=2 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:44:33 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=26,cinder:INSERT=7,cinder:UPDATE=20 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:44:33 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98 Jul 08 14:44:33 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:34 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98" returned: 0 in 1.325s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:34 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Image conversion details: src /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98, size 1024.00 MB, duration 7.67 sec, destination /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a10532b6-3802-4226-a914-10d671a18695 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:44:34 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Converted 1024.00 MB image at 133.48 MB/s Jul 08 14:44:34 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a10532b6-3802-4226-a914-10d671a18695 is being set with open permissions: ugo+rw Jul 08 14:44:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a10532b6-3802-4226-a914-10d671a18695 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:34 devstack sudo[101168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a10532b6-3802-4226-a914-10d671a18695 Jul 08 14:44:34 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:35 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a10532b6-3802-4226-a914-10d671a18695" returned: 0 in 0.865s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-a10532b6-3802-4226-a914-10d671a18695" released by "_copy_volume_from_snapshot" :: held 12.066s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-19f03362-0cfd-4d51-8f3f-751bdef0257e-a10532b6-3802-4226-a914-10d671a18695" released by "_create_volume_from_snapshot" :: held 12.111s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.130s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e6ec588-ed1d-44aa-8da7-b82a9c8c653b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a10532b6-3802-4226-a914-10d671a18695', 'volume_size': 2, 'snapshot_id': '19f03362-0cfd-4d51-8f3f-751bdef0257e'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf35edc-2054-4e95-9a14-79576f709943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:35 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Volume volume-a10532b6-3802-4226-a914-10d671a18695 (a10532b6-3802-4226-a914-10d671a18695): created successfully Jul 08 14:44:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf35edc-2054-4e95-9a14-79576f709943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Flow 'volume_create_manager' (8228f706-460a-4c64-ac5f-8c795c3ac158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:44:35 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-70147e0d-9b5c-4488-8c87-b3b6af841ed9 tempest-VolumesSnapshotTestJSON-1895351254 None] Created volume successfully. Jul 08 14:44:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-90633518-f29b-4e2b-a43d-7e819d7d705a tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "cinder-a10532b6-3802-4226-a914-10d671a18695-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-90633518-f29b-4e2b-a43d-7e819d7d705a tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-a10532b6-3802-4226-a914-10d671a18695-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-90633518-f29b-4e2b-a43d-7e819d7d705a tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "cinder-quobyte-a10532b6-3802-4226-a914-10d671a18695" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-90633518-f29b-4e2b-a43d-7e819d7d705a tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-a10532b6-3802-4226-a914-10d671a18695" acquired by "delete_volume" :: waited 0.030s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:36 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdd0275-4453-46ef-a46c-0836889befed]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-90633518-f29b-4e2b-a43d-7e819d7d705a tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a10532b6-3802-4226-a914-10d671a18695 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:36 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a10532b6-3802-4226-a914-10d671a18695 Jul 08 14:44:36 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:37 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-90633518-f29b-4e2b-a43d-7e819d7d705a tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a10532b6-3802-4226-a914-10d671a18695" returned: 0 in 0.871s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-90633518-f29b-4e2b-a43d-7e819d7d705a tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a10532b6-3802-4226-a914-10d671a18695 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:37 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a10532b6-3802-4226-a914-10d671a18695 Jul 08 14:44:37 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:38 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-90633518-f29b-4e2b-a43d-7e819d7d705a tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a10532b6-3802-4226-a914-10d671a18695" returned: 0 in 0.909s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-90633518-f29b-4e2b-a43d-7e819d7d705a tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-a10532b6-3802-4226-a914-10d671a18695" released by "delete_volume" :: held 1.848s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:38 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-90633518-f29b-4e2b-a43d-7e819d7d705a tempest-VolumesSnapshotTestJSON-1895351254 None] Created reservations ['bec9837c-5018-45ae-a6cf-b27a310fa47c', 'b1101dbd-53ce-4922-9010-ad74ffb6e8cc', '0945358e-8585-4e84-a6b0-7f783fa88f98', '50bb54bb-d89e-4754-8c90-50104912c203'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:44:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-90633518-f29b-4e2b-a43d-7e819d7d705a tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-90633518-f29b-4e2b-a43d-7e819d7d705a tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-90633518-f29b-4e2b-a43d-7e819d7d705a tempest-VolumesSnapshotTestJSON-1895351254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:44:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-90633518-f29b-4e2b-a43d-7e819d7d705a tempest-VolumesSnapshotTestJSON-1895351254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:44:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-90633518-f29b-4e2b-a43d-7e819d7d705a tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-90633518-f29b-4e2b-a43d-7e819d7d705a tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:38 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:44:38 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a50e58c9-9cbc-49e8-a1ed-aa022569189d tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "cinder-19f03362-0cfd-4d51-8f3f-751bdef0257e-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a50e58c9-9cbc-49e8-a1ed-aa022569189d tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-19f03362-0cfd-4d51-8f3f-751bdef0257e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a50e58c9-9cbc-49e8-a1ed-aa022569189d tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "cinder-quobyte-54dcf753-3944-4fea-950c-9a1e28664c98" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a50e58c9-9cbc-49e8-a1ed-aa022569189d tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-54dcf753-3944-4fea-950c-9a1e28664c98" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a50e58c9-9cbc-49e8-a1ed-aa022569189d tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "cinder-quobyte-19f03362-0cfd-4d51-8f3f-751bdef0257e" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a50e58c9-9cbc-49e8-a1ed-aa022569189d tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-19f03362-0cfd-4d51-8f3f-751bdef0257e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a50e58c9-9cbc-49e8-a1ed-aa022569189d tempest-VolumesSnapshotTestJSON-1895351254 None] Deleting offline snapshot 19f03362-0cfd-4d51-8f3f-751bdef0257e of volume 54dcf753-3944-4fea-950c-9a1e28664c98 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:44:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a50e58c9-9cbc-49e8-a1ed-aa022569189d tempest-VolumesSnapshotTestJSON-1895351254 None] snapshot_file for this snap is: volume-54dcf753-3944-4fea-950c-9a1e28664c98.19f03362-0cfd-4d51-8f3f-751bdef0257e {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:44:38 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b5f9f1-91ca-4a76-ae4b-8801c53cbc2e]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a50e58c9-9cbc-49e8-a1ed-aa022569189d tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.19f03362-0cfd-4d51-8f3f-751bdef0257e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:38 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.19f03362-0cfd-4d51-8f3f-751bdef0257e Jul 08 14:44:38 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:39 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-90633518-f29b-4e2b-a43d-7e819d7d705a tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.939s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:39 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-90633518-f29b-4e2b-a43d-7e819d7d705a tempest-VolumesSnapshotTestJSON-1895351254 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:44:39 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-90633518-f29b-4e2b-a43d-7e819d7d705a tempest-VolumesSnapshotTestJSON-1895351254 None] Deleted volume successfully. Jul 08 14:44:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-90633518-f29b-4e2b-a43d-7e819d7d705a tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-a10532b6-3802-4226-a914-10d671a18695-delete_volume" released by "delete_volume" :: held 3.082s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:39 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a50e58c9-9cbc-49e8-a1ed-aa022569189d tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.19f03362-0cfd-4d51-8f3f-751bdef0257e" returned: 0 in 1.076s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a50e58c9-9cbc-49e8-a1ed-aa022569189d tempest-VolumesSnapshotTestJSON-1895351254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54dcf753-3944-4fea-950c-9a1e28664c98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:44:39 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b253c0-6c0d-4b63-b0da-66fcce0e7c83]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a50e58c9-9cbc-49e8-a1ed-aa022569189d tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:40 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98 Jul 08 14:44:40 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:40 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:44:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Flow 'volume_create_manager' (d98c5017-d15d-4385-9bd8-059077d4ec44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:44:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39c2dd9-55fb-4e63-a7b1-431c2d0f93dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39c2dd9-55fb-4e63-a7b1-431c2d0f93dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26e000d-f3a6-4a33-9aca-670d97440273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='351775f7acc24a99862098aacf2499d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:44:41Z,use_quota=True,user_id='58fc901ca26848a8a04e4ef20f2f279b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f318e2d-c41b-4041-bb13-8f10e384ed16),volume_type_id=1f318e2d-c41b-4041-bb13-8f10e384ed16)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d45949-b9e5-48ee-a029-298691bd4668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94d45949-b9e5-48ee-a029-298691bd4668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd06e6c5-ef47-4b6f-a32f-6966ed8aeb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:40 devstack cinder-volume[87240]: DEBUG cinder.image.glance [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Creating Keystone auth plugin from conf {{(pid=87240) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 14:44:40 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a50e58c9-9cbc-49e8-a1ed-aa022569189d tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98" returned: 0 in 0.967s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a50e58c9-9cbc-49e8-a1ed-aa022569189d tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.19f03362-0cfd-4d51-8f3f-751bdef0257e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:40 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.19f03362-0cfd-4d51-8f3f-751bdef0257e Jul 08 14:44:40 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd06e6c5-ef47-4b6f-a32f-6966ed8aeb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd26e000d-f3a6-4a33-9aca-670d97440273', 'volume_name': 'volume-d26e000d-f3a6-4a33-9aca-670d97440273', 'volume_size': 1, 'image_id': 'e31f3fa0-cc53-4e7e-8b93-c1f619f51826', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e31f3fa0-cc53-4e7e-8b93-c1f619f51826', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '066926402192f7b7698ed175a9b54c9e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '351775f7acc24a99862098aacf2499d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a4911f1ca7d40b487ecd58e85e71a02ff224385f5318482ad06e07a4c13d3e8c331e08a1b810193cb8665ea8208d016a327e612b857e15c57c06e8d040a05b9a', 'id': 'e31f3fa0-cc53-4e7e-8b93-c1f619f51826', 'created_at': datetime.datetime(2026, 7, 8, 12, 44, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 44, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e31f3fa0-cc53-4e7e-8b93-c1f619f51826/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b17648-8a69-408e-ae68-90b398479bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16b17648-8a69-408e-ae68-90b398479bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5ffaa3-53b2-4692-b802-e71cbd10f782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:41 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Volume d26e000d-f3a6-4a33-9aca-670d97440273: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d26e000d-f3a6-4a33-9aca-670d97440273', 'volume_size': 1, 'image_id': 'e31f3fa0-cc53-4e7e-8b93-c1f619f51826', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e31f3fa0-cc53-4e7e-8b93-c1f619f51826', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '066926402192f7b7698ed175a9b54c9e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '351775f7acc24a99862098aacf2499d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a4911f1ca7d40b487ecd58e85e71a02ff224385f5318482ad06e07a4c13d3e8c331e08a1b810193cb8665ea8208d016a327e612b857e15c57c06e8d040a05b9a', 'id': 'e31f3fa0-cc53-4e7e-8b93-c1f619f51826', 'created_at': datetime.datetime(2026, 7, 8, 12, 44, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 44, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e31f3fa0-cc53-4e7e-8b93-c1f619f51826/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 14:44:41 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Trying to clone d26e000d-f3a6-4a33-9aca-670d97440273 from image e31f3fa0-cc53-4e7e-8b93-c1f619f51826 at location (None, [{'url': 'file:///opt/stack/data/glance/images/e31f3fa0-cc53-4e7e-8b93-c1f619f51826', 'metadata': {}}]). {{(pid=87240) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 14:44:41 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 14:44:41 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Image download 0.00 MB at 0.00 MB/s Jul 08 14:44:41 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b03d22-72cf-4021-b5e7-95c7e3455013]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:41 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD Jul 08 14:44:41 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:41 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a50e58c9-9cbc-49e8-a1ed-aa022569189d tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.19f03362-0cfd-4d51-8f3f-751bdef0257e" returned: 0 in 0.839s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a50e58c9-9cbc-49e8-a1ed-aa022569189d tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.19f03362-0cfd-4d51-8f3f-751bdef0257e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:41 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.19f03362-0cfd-4d51-8f3f-751bdef0257e Jul 08 14:44:41 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:42 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD" returned: 0 in 0.806s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:42 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD Jul 08 14:44:42 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:42 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a50e58c9-9cbc-49e8-a1ed-aa022569189d tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98.19f03362-0cfd-4d51-8f3f-751bdef0257e" returned: 0 in 0.710s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a50e58c9-9cbc-49e8-a1ed-aa022569189d tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-19f03362-0cfd-4d51-8f3f-751bdef0257e" released by "_delete_snapshot" :: held 3.725s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a50e58c9-9cbc-49e8-a1ed-aa022569189d tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-54dcf753-3944-4fea-950c-9a1e28664c98" released by "delete_snapshot" :: held 3.754s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:42 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-a50e58c9-9cbc-49e8-a1ed-aa022569189d tempest-VolumesSnapshotTestJSON-1895351254 None] Created reservations ['d3e1e9ef-d732-4ded-848c-3e8befa44345', 'b3b8fc9f-2b3d-4993-af40-4914a097538c', 'a459e3b2-832d-4568-8f7e-d7df6a578225', 'ac0cc810-8140-4261-a04e-606518beff8a'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:44:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a50e58c9-9cbc-49e8-a1ed-aa022569189d tempest-VolumesSnapshotTestJSON-1895351254 None] Delete snapshot completed successfully. Jul 08 14:44:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a50e58c9-9cbc-49e8-a1ed-aa022569189d tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-19f03362-0cfd-4d51-8f3f-751bdef0257e-delete_snapshot" released by "delete_snapshot" :: held 3.940s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:42 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD" returned: 1 in 0.764s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:44:42 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Temporary image e31f3fa0-cc53-4e7e-8b93-c1f619f51826 is fetched for user 58fc901ca26848a8a04e4ef20f2f279b. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 14:44:42 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a14d4cc-b8c8-4345-b44c-ed95a1cd8c6a]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9a71d188-6bc8-4d12-8a04-2ca8f2fdaeb8 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "cinder-54dcf753-3944-4fea-950c-9a1e28664c98-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9a71d188-6bc8-4d12-8a04-2ca8f2fdaeb8 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-54dcf753-3944-4fea-950c-9a1e28664c98-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:43 devstack sudo[101230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD Jul 08 14:44:43 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9a71d188-6bc8-4d12-8a04-2ca8f2fdaeb8 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "cinder-quobyte-54dcf753-3944-4fea-950c-9a1e28664c98" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9a71d188-6bc8-4d12-8a04-2ca8f2fdaeb8 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-54dcf753-3944-4fea-950c-9a1e28664c98" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:43 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[431387ae-b2fd-452d-a883-970108c6c10a]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9a71d188-6bc8-4d12-8a04-2ca8f2fdaeb8 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:43 devstack sudo[101232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98 Jul 08 14:44:43 devstack sudo[101232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:43 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD" returned: 0 in 0.889s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:43 devstack sudo[101236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD Jul 08 14:44:43 devstack sudo[101236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:44 devstack sudo[101232]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9a71d188-6bc8-4d12-8a04-2ca8f2fdaeb8 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98" returned: 0 in 0.926s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9a71d188-6bc8-4d12-8a04-2ca8f2fdaeb8 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:44 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98 Jul 08 14:44:44 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:44 devstack sudo[101236]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD" returned: 1 in 0.816s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:44:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:44:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d26e000d-f3a6-4a33-9aca-670d97440273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='351775f7acc24a99862098aacf2499d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:44:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:44:41Z,use_quota=True,user_id='58fc901ca26848a8a04e4ef20f2f279b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f318e2d-c41b-4041-bb13-8f10e384ed16),volume_type_id=1f318e2d-c41b-4041-bb13-8f10e384ed16)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:44:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Creating volume d26e000d-f3a6-4a33-9aca-670d97440273 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:44:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:44:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:44:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:44:44 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:44:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:44 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273 1073741824 Jul 08 14:44:44 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:44 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9a71d188-6bc8-4d12-8a04-2ca8f2fdaeb8 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-54dcf753-3944-4fea-950c-9a1e28664c98" returned: 0 in 0.747s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9a71d188-6bc8-4d12-8a04-2ca8f2fdaeb8 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-54dcf753-3944-4fea-950c-9a1e28664c98" released by "delete_volume" :: held 1.786s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:44 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-9a71d188-6bc8-4d12-8a04-2ca8f2fdaeb8 tempest-VolumesSnapshotTestJSON-1895351254 None] Created reservations ['698067cc-0347-4c8d-a785-8452f6b9ce18', 'a6488aab-bb04-41b0-9718-2ce55339d10d', '1203c0aa-c912-45d9-ac3e-6681cbd5544b', 'c0eb592d-3f46-49ab-be08-b1c6d424eb67'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:44:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9a71d188-6bc8-4d12-8a04-2ca8f2fdaeb8 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9a71d188-6bc8-4d12-8a04-2ca8f2fdaeb8 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9a71d188-6bc8-4d12-8a04-2ca8f2fdaeb8 tempest-VolumesSnapshotTestJSON-1895351254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:44:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9a71d188-6bc8-4d12-8a04-2ca8f2fdaeb8 tempest-VolumesSnapshotTestJSON-1895351254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:44:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9a71d188-6bc8-4d12-8a04-2ca8f2fdaeb8 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9a71d188-6bc8-4d12-8a04-2ca8f2fdaeb8 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:45 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:44:45 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:45 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273 1073741824" returned: 0 in 0.995s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:45 devstack sudo[101255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273 Jul 08 14:44:45 devstack sudo[101255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:45 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:44:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Flow 'volume_create_manager' (840186e2-3775-4e4a-8a68-cef1316ab891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:44:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c3615d-28f9-4a74-a205-56a56c19021a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86c3615d-28f9-4a74-a205-56a56c19021a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-439313844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b11114dce564cf88c7b7a9554b7a7af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:44:46Z,use_quota=True,user_id='08689ea63e384a7fa9b226b114081132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:45 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd809eca-7f26-4c8f-89b2-036d575d2e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd809eca-7f26-4c8f-89b2-036d575d2e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (354f4381-85f0-47f7-adb9-908435f75bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (354f4381-85f0-47f7-adb9-908435f75bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f', 'volume_name': 'volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e4c0be-1b2e-478e-be38-39d275f9d0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e4c0be-1b2e-478e-be38-39d275f9d0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20cb38c6-4a22-4d6e-a3d9-c6a9d6c8a2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:46 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Volume e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f', 'volume_size': 1} Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9a71d188-6bc8-4d12-8a04-2ca8f2fdaeb8 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.943s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-9a71d188-6bc8-4d12-8a04-2ca8f2fdaeb8 tempest-VolumesSnapshotTestJSON-1895351254 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:44:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9a71d188-6bc8-4d12-8a04-2ca8f2fdaeb8 tempest-VolumesSnapshotTestJSON-1895351254 None] Deleted volume successfully. Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9a71d188-6bc8-4d12-8a04-2ca8f2fdaeb8 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-54dcf753-3944-4fea-950c-9a1e28664c98-delete_volume" released by "delete_volume" :: held 2.984s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:46 devstack sudo[101255]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273" returned: 0 in 0.729s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.792s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.437s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:44:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-439313844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b11114dce564cf88c7b7a9554b7a7af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:44:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:44:46Z,use_quota=True,user_id='08689ea63e384a7fa9b226b114081132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Creating volume e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:44:46 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:46 devstack sudo[101259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f 1073741824 Jul 08 14:44:46 devstack sudo[101259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Attempting download of e31f3fa0-cc53-4e7e-8b93-c1f619f51826 ((None, [{'url': 'file:///opt/stack/data/glance/images/e31f3fa0-cc53-4e7e-8b93-c1f619f51826', 'metadata': {}}])) to volume d26e000d-f3a6-4a33-9aca-670d97440273. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1515dc4c-bdcf-43de-8f0a-849d218019df]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_00s70khv {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:46 devstack sudo[101261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_00s70khv Jul 08 14:44:46 devstack sudo[101261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:47 devstack sudo[101259]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f 1073741824" returned: 0 in 0.894s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:47 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f Jul 08 14:44:47 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:47 devstack sudo[101261]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_00s70khv" returned: 0 in 0.965s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_00s70khv {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:47 devstack sudo[101270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_00s70khv Jul 08 14:44:47 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:48 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f" returned: 0 in 0.960s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] <== create_volume: return (1921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:44:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.924s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20cb38c6-4a22-4d6e-a3d9-c6a9d6c8a2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8bcf64-95ca-479a-a7c2-adcf2d8d8de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:48 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Volume volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f (e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f): created successfully Jul 08 14:44:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da8bcf64-95ca-479a-a7c2-adcf2d8d8de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Flow 'volume_create_manager' (840186e2-3775-4e4a-8a68-cef1316ab891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:44:48 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fb787065-705c-40a5-ba45-64d996132223 tempest-VolumesSnapshotTestJSON-1895351254 None] Created volume successfully. Jul 08 14:44:48 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_00s70khv" returned: 1 in 1.034s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_00s70khv' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:44:48 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65833b8-a9b1-477d-9d46-5d436457286f]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:48 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD Jul 08 14:44:48 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-42f7e6dc-0a32-48aa-b74f-72886a625b37 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-42f7e6dc-0a32-48aa-b74f-72886a625b37 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-42f7e6dc-0a32-48aa-b74f-72886a625b37 tempest-VolumesSnapshotTestJSON-1895351254 None] Creating offline snapshot 398d22df-ef82-4a16-8902-6a8f8c68d6ed of volume e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:44:49 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2637e9f3-c15f-4af6-b115-4d985c70cefb]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42f7e6dc-0a32-48aa-b74f-72886a625b37 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:49 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD" returned: 0 in 1.023s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:49 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f Jul 08 14:44:49 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:49 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD Jul 08 14:44:49 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:50 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42f7e6dc-0a32-48aa-b74f-72886a625b37 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f" returned: 0 in 0.909s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42f7e6dc-0a32-48aa-b74f-72886a625b37 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.398d22df-ef82-4a16-8902-6a8f8c68d6ed 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:50 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.398d22df-ef82-4a16-8902-6a8f8c68d6ed 1G Jul 08 14:44:50 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:50 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD" returned: 1 in 0.879s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:44:50 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] e31f3fa0-cc53-4e7e-8b93-c1f619f51826 was raw, converting to raw {{(pid=87240) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 14:44:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:50 devstack sudo[101328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273 Jul 08 14:44:50 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:51 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42f7e6dc-0a32-48aa-b74f-72886a625b37 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.398d22df-ef82-4a16-8902-6a8f8c68d6ed 1G" returned: 0 in 0.892s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42f7e6dc-0a32-48aa-b74f-72886a625b37 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.398d22df-ef82-4a16-8902-6a8f8c68d6ed {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:51 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.398d22df-ef82-4a16-8902-6a8f8c68d6ed Jul 08 14:44:51 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:51 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273" returned: 0 in 0.841s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:51 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e31f3fa0-cc53-4e7e-8b93-c1f619f51826_qxbc43ybdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:44:51 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 14:44:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:51 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273 1G Jul 08 14:44:51 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:52 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273 1G" returned: 0 in 0.729s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:52 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42f7e6dc-0a32-48aa-b74f-72886a625b37 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.398d22df-ef82-4a16-8902-6a8f8c68d6ed" returned: 0 in 0.820s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:52 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-42f7e6dc-0a32-48aa-b74f-72886a625b37 tempest-VolumesSnapshotTestJSON-1895351254 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.398d22df-ef82-4a16-8902-6a8f8c68d6ed is being set with open permissions: ugo+rw Jul 08 14:44:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42f7e6dc-0a32-48aa-b74f-72886a625b37 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.398d22df-ef82-4a16-8902-6a8f8c68d6ed {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:52 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9384582a-0c8a-405d-848d-6b27e4a6c32d]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:52 devstack sudo[101354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.398d22df-ef82-4a16-8902-6a8f8c68d6ed Jul 08 14:44:52 devstack sudo[101354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:52 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273 Jul 08 14:44:52 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:52 devstack sudo[101354]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42f7e6dc-0a32-48aa-b74f-72886a625b37 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.398d22df-ef82-4a16-8902-6a8f8c68d6ed" returned: 0 in 0.803s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42f7e6dc-0a32-48aa-b74f-72886a625b37 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:52 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273" returned: 0 in 0.845s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:52 devstack sudo[101364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.info Jul 08 14:44:52 devstack sudo[101364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:53 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273 Jul 08 14:44:53 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:53 devstack sudo[101364]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42f7e6dc-0a32-48aa-b74f-72886a625b37 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.info" returned: 0 in 0.720s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:53 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-42f7e6dc-0a32-48aa-b74f-72886a625b37 tempest-VolumesSnapshotTestJSON-1895351254 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.info is being set with open permissions: ugo+rw Jul 08 14:44:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42f7e6dc-0a32-48aa-b74f-72886a625b37 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:53 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.info Jul 08 14:44:53 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:53 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273" returned: 1 in 0.929s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:44:53 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Downloaded image e31f3fa0-cc53-4e7e-8b93-c1f619f51826 ((None, [{'url': 'file:///opt/stack/data/glance/images/e31f3fa0-cc53-4e7e-8b93-c1f619f51826', 'metadata': {}}])) to volume d26e000d-f3a6-4a33-9aca-670d97440273 successfully. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 14:44:53 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Temporary image e31f3fa0-cc53-4e7e-8b93-c1f619f51826 for user 58fc901ca26848a8a04e4ef20f2f279b is deleted. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 14:44:53 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Marking volume d26e000d-f3a6-4a33-9aca-670d97440273 as bootable. {{(pid=87240) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 14:44:53 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Copying metadata from image e31f3fa0-cc53-4e7e-8b93-c1f619f51826 to d26e000d-f3a6-4a33-9aca-670d97440273. {{(pid=87240) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 14:44:53 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Creating volume glance metadata for volume d26e000d-f3a6-4a33-9aca-670d97440273 backed by image e31f3fa0-cc53-4e7e-8b93-c1f619f51826 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e31f3fa0-cc53-4e7e-8b93-c1f619f51826', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '066926402192f7b7698ed175a9b54c9e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87240) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 14:44:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5ffaa3-53b2-4692-b802-e71cbd10f782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d26e000d-f3a6-4a33-9aca-670d97440273', 'volume_size': 1, 'image_id': 'e31f3fa0-cc53-4e7e-8b93-c1f619f51826', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e31f3fa0-cc53-4e7e-8b93-c1f619f51826', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '066926402192f7b7698ed175a9b54c9e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '351775f7acc24a99862098aacf2499d4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a4911f1ca7d40b487ecd58e85e71a02ff224385f5318482ad06e07a4c13d3e8c331e08a1b810193cb8665ea8208d016a327e612b857e15c57c06e8d040a05b9a', 'id': 'e31f3fa0-cc53-4e7e-8b93-c1f619f51826', 'created_at': datetime.datetime(2026, 7, 8, 12, 44, 38, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 44, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e31f3fa0-cc53-4e7e-8b93-c1f619f51826/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79315ec-20e7-4c91-9fe8-54fca7a6ef37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:54 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Volume volume-d26e000d-f3a6-4a33-9aca-670d97440273 (d26e000d-f3a6-4a33-9aca-670d97440273): created successfully Jul 08 14:44:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d79315ec-20e7-4c91-9fe8-54fca7a6ef37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Flow 'volume_create_manager' (d98c5017-d15d-4385-9bd8-059077d4ec44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:44:54 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f3140736-b4bb-41d2-9c7b-922eb52ab70c tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Created volume successfully. Jul 08 14:44:54 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-42f7e6dc-0a32-48aa-b74f-72886a625b37 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.info" returned: 0 in 0.745s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-42f7e6dc-0a32-48aa-b74f-72886a625b37 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.015s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:54 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-42f7e6dc-0a32-48aa-b74f-72886a625b37 tempest-VolumesSnapshotTestJSON-1895351254 None] Create snapshot completed successfully Jul 08 14:44:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Acquiring lock "cinder-d26e000d-f3a6-4a33-9aca-670d97440273-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Lock "cinder-d26e000d-f3a6-4a33-9aca-670d97440273-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Acquiring lock "cinder-quobyte-d26e000d-f3a6-4a33-9aca-670d97440273" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Lock "cinder-quobyte-d26e000d-f3a6-4a33-9aca-670d97440273" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:54 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec9c83d-aa3c-4f9e-b346-ea745d8c97ef]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:54 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273 Jul 08 14:44:54 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Flow 'volume_create_manager' (45fb891a-9d50-4cac-a63a-a8ebb69a6e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5b2d44-78b8-46a2-b983-7066fdf95ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc5b2d44-78b8-46a2-b983-7066fdf95ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:44:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-53036662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c879b9b-101b-43f5-87f1-312fd7bf5b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b11114dce564cf88c7b7a9554b7a7af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:44:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=398d22df-ef82-4a16-8902-6a8f8c68d6ed,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:44:55Z,use_quota=True,user_id='08689ea63e384a7fa9b226b114081132',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa37388a-fa01-4232-b5ec-48ee3824cd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa37388a-fa01-4232-b5ec-48ee3824cd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075c7327-2e3e-4f6b-9795-13451ea9b8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (075c7327-2e3e-4f6b-9795-13451ea9b8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6c879b9b-101b-43f5-87f1-312fd7bf5b03', 'volume_name': 'volume-6c879b9b-101b-43f5-87f1-312fd7bf5b03', 'volume_size': 1, 'snapshot_id': '398d22df-ef82-4a16-8902-6a8f8c68d6ed'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208372d5-63fc-4c6c-868e-37d3d75fcd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208372d5-63fc-4c6c-868e-37d3d75fcd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ce003b-2a7c-4665-9edc-2ca29c01ba15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:44:55 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Volume 6c879b9b-101b-43f5-87f1-312fd7bf5b03: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6c879b9b-101b-43f5-87f1-312fd7bf5b03', 'volume_size': 1, 'snapshot_id': '398d22df-ef82-4a16-8902-6a8f8c68d6ed'} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "cinder-quobyte-398d22df-ef82-4a16-8902-6a8f8c68d6ed-6c879b9b-101b-43f5-87f1-312fd7bf5b03" by "_create_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-398d22df-ef82-4a16-8902-6a8f8c68d6ed-6c879b9b-101b-43f5-87f1-312fd7bf5b03" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Creating volume 6c879b9b-101b-43f5-87f1-312fd7bf5b03 from snapshot 398d22df-ef82-4a16-8902-6a8f8c68d6ed {{(pid=87240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "cinder-quobyte-6c879b9b-101b-43f5-87f1-312fd7bf5b03" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-6c879b9b-101b-43f5-87f1-312fd7bf5b03" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] snapshot: 398d22df-ef82-4a16-8902-6a8f8c68d6ed, volume: 6c879b9b-101b-43f5-87f1-312fd7bf5b03, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a40c31-2f5b-40e7-81ca-652688a587fc]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.398d22df-ef82-4a16-8902-6a8f8c68d6ed {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:55 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273" returned: 0 in 0.848s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:55 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.398d22df-ef82-4a16-8902-6a8f8c68d6ed Jul 08 14:44:55 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:55 devstack sudo[101385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273 Jul 08 14:44:55 devstack sudo[101385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:56 devstack sudo[101385]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273" returned: 1 in 0.808s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:44:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:56 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273 Jul 08 14:44:56 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:56 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.398d22df-ef82-4a16-8902-6a8f8c68d6ed" returned: 0 in 0.921s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:44:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:44:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:44:56 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c19b441-16ef-4b27-953b-988a9b6c7fa5]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:44:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:56 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f Jul 08 14:44:56 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:57 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-d26e000d-f3a6-4a33-9aca-670d97440273" returned: 0 in 0.745s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Lock "cinder-quobyte-d26e000d-f3a6-4a33-9aca-670d97440273" released by "delete_volume" :: held 2.491s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:57 devstack cinder-volume[87240]: WARNING cinder.quota [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:44:57 devstack cinder-volume[87240]: WARNING cinder.quota [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 14:44:57 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Created reservations ['e819eaee-37d6-4b56-873e-87a142c80cad', '8af24a82-2684-4f2f-b689-0777a9b60807', '7e25efef-08eb-4ac5-b052-adf84330efeb', 'ad66afc5-ca0e-4377-ac4d-a179e8562d77'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:44:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:44:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:44:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:57 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:44:57 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:57 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f" returned: 0 in 0.932s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:57 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Path /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6c879b9b-101b-43f5-87f1-312fd7bf5b03 not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:44:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6c879b9b-101b-43f5-87f1-312fd7bf5b03 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:57 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6c879b9b-101b-43f5-87f1-312fd7bf5b03 Jul 08 14:44:57 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:44:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-ed2fe702-7709-4156-ba11-44b5686ada94 req-e9bd8f40-78f9-4ed3-bdb0-2d168fd0b170 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:58 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Jul 08 14:44:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.750s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:44:58 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:44:58 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Deleted volume successfully. Jul 08 14:44:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aedc3067-f27c-4a40-b970-4558116bfcb8 tempest-VolumeAndVolumeTypeFromImageTest-1978504781 None] Lock "cinder-d26e000d-f3a6-4a33-9aca-670d97440273-delete_volume" released by "delete_volume" :: held 3.501s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:44:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:44:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:44:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:44:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:44:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:44:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:44:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:44:59 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:44:59 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:00 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.162s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:45:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:45:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:45:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:45:03 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6c879b9b-101b-43f5-87f1-312fd7bf5b03" returned: 0 in 6.151s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:03 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[083c00a2-8a0c-4b85-9c91-54ba156aa644]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:03 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f Jul 08 14:45:03 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:04 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f" returned: 0 in 1.062s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:04 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Image conversion details: src /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f, size 1024.00 MB, duration 6.15 sec, destination /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6c879b9b-101b-43f5-87f1-312fd7bf5b03 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:45:04 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Converted 1024.00 MB image at 166.44 MB/s Jul 08 14:45:04 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6c879b9b-101b-43f5-87f1-312fd7bf5b03 is being set with open permissions: ugo+rw Jul 08 14:45:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6c879b9b-101b-43f5-87f1-312fd7bf5b03 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:04 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6c879b9b-101b-43f5-87f1-312fd7bf5b03 Jul 08 14:45:04 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:05 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6c879b9b-101b-43f5-87f1-312fd7bf5b03" returned: 0 in 0.755s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-6c879b9b-101b-43f5-87f1-312fd7bf5b03" released by "_copy_volume_from_snapshot" :: held 9.955s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-398d22df-ef82-4a16-8902-6a8f8c68d6ed-6c879b9b-101b-43f5-87f1-312fd7bf5b03" released by "_create_volume_from_snapshot" :: held 9.987s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.004s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-ed2fe702-7709-4156-ba11-44b5686ada94 req-e9bd8f40-78f9-4ed3-bdb0-2d168fd0b170 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.450s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:05 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[65489491-3570-4ac6-b2e8-f7f654601993]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-ed2fe702-7709-4156-ba11-44b5686ada94 req-e9bd8f40-78f9-4ed3-bdb0-2d168fd0b170 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8b8381bf-6f06-4767-9e19-19816905aa00 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ce003b-2a7c-4665-9edc-2ca29c01ba15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c879b9b-101b-43f5-87f1-312fd7bf5b03', 'volume_size': 1, 'snapshot_id': '398d22df-ef82-4a16-8902-6a8f8c68d6ed'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca480bba-126a-4637-b42a-bdd4c5af28cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:05 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Volume volume-6c879b9b-101b-43f5-87f1-312fd7bf5b03 (6c879b9b-101b-43f5-87f1-312fd7bf5b03): created successfully Jul 08 14:45:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca480bba-126a-4637-b42a-bdd4c5af28cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Flow 'volume_create_manager' (45fb891a-9d50-4cac-a63a-a8ebb69a6e19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:05 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7271c7b6-83f1-4afd-833b-9524e34e2959 tempest-VolumesSnapshotTestJSON-1895351254 None] Created volume successfully. Jul 08 14:45:05 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8b8381bf-6f06-4767-9e19-19816905aa00 Jul 08 14:45:05 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:05 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:45:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Flow 'volume_create_manager' (95e75195-461d-4d3d-9d1f-34779b5677c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c899b29-7e7f-4112-b522-d65fc0a17791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c899b29-7e7f-4112-b522-d65fc0a17791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8055ab54-1619-4765-8d0f-cfb110ad25bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cbac4c90311402798b6595e6d9f3ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:06Z,use_quota=True,user_id='a64bd546d01041fbad49a0a2463112a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff311aa2-d034-46d3-96e0-1a5e51ed615c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff311aa2-d034-46d3-96e0-1a5e51ed615c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7e613a-8b8f-424c-87c4-2567ded94bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7e613a-8b8f-424c-87c4-2567ded94bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8055ab54-1619-4765-8d0f-cfb110ad25bf', 'volume_name': 'volume-8055ab54-1619-4765-8d0f-cfb110ad25bf', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998c89df-a0b2-497c-bbf2-4982afb7af03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998c89df-a0b2-497c-bbf2-4982afb7af03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dbd5ec6-ec9e-4a55-8115-e539425fe3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:06 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Volume 8055ab54-1619-4765-8d0f-cfb110ad25bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8055ab54-1619-4765-8d0f-cfb110ad25bf', 'volume_size': 1} Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4aed4255-9814-43e0-96c9-28f3462e520f tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "cinder-6c879b9b-101b-43f5-87f1-312fd7bf5b03-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4aed4255-9814-43e0-96c9-28f3462e520f tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-6c879b9b-101b-43f5-87f1-312fd7bf5b03-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4aed4255-9814-43e0-96c9-28f3462e520f tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "cinder-quobyte-6c879b9b-101b-43f5-87f1-312fd7bf5b03" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4aed4255-9814-43e0-96c9-28f3462e520f tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-6c879b9b-101b-43f5-87f1-312fd7bf5b03" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2634418-2712-4b4c-b48e-f9140b592b3f]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4aed4255-9814-43e0-96c9-28f3462e520f tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6c879b9b-101b-43f5-87f1-312fd7bf5b03 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:06 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6c879b9b-101b-43f5-87f1-312fd7bf5b03 Jul 08 14:45:06 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:06 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-ed2fe702-7709-4156-ba11-44b5686ada94 req-e9bd8f40-78f9-4ed3-bdb0-2d168fd0b170 tempest-TestServerVolumeAttachmentScenario-1132260277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8b8381bf-6f06-4767-9e19-19816905aa00" returned: 0 in 0.945s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-ed2fe702-7709-4156-ba11-44b5686ada94 req-e9bd8f40-78f9-4ed3-bdb0-2d168fd0b170 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.976s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.438s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:06Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8055ab54-1619-4765-8d0f-cfb110ad25bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cbac4c90311402798b6595e6d9f3ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:06Z,use_quota=True,user_id='a64bd546d01041fbad49a0a2463112a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Creating volume 8055ab54-1619-4765-8d0f-cfb110ad25bf {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:45:06 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8055ab54-1619-4765-8d0f-cfb110ad25bf 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:06 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8055ab54-1619-4765-8d0f-cfb110ad25bf 1073741824 Jul 08 14:45:06 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-ed2fe702-7709-4156-ba11-44b5686ada94 req-e9bd8f40-78f9-4ed3-bdb0-2d168fd0b170 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad', 'name': 'volume-8b8381bf-6f06-4767-9e19-19816905aa00', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c40bd934-9077-41b5-b8bb-b3f739a4aad4', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:45:06 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-ed2fe702-7709-4156-ba11-44b5686ada94 req-e9bd8f40-78f9-4ed3-bdb0-2d168fd0b170 tempest-TestServerVolumeAttachmentScenario-1132260277 None] attachment_update completed successfully. Jul 08 14:45:07 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4aed4255-9814-43e0-96c9-28f3462e520f tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6c879b9b-101b-43f5-87f1-312fd7bf5b03" returned: 0 in 0.837s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4aed4255-9814-43e0-96c9-28f3462e520f tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6c879b9b-101b-43f5-87f1-312fd7bf5b03 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:07 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6c879b9b-101b-43f5-87f1-312fd7bf5b03 Jul 08 14:45:07 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:07 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8055ab54-1619-4765-8d0f-cfb110ad25bf 1073741824" returned: 0 in 0.959s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8055ab54-1619-4765-8d0f-cfb110ad25bf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:07 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8055ab54-1619-4765-8d0f-cfb110ad25bf Jul 08 14:45:07 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:07 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4aed4255-9814-43e0-96c9-28f3462e520f tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6c879b9b-101b-43f5-87f1-312fd7bf5b03" returned: 0 in 0.766s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4aed4255-9814-43e0-96c9-28f3462e520f tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-6c879b9b-101b-43f5-87f1-312fd7bf5b03" released by "delete_volume" :: held 1.656s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:07 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-4aed4255-9814-43e0-96c9-28f3462e520f tempest-VolumesSnapshotTestJSON-1895351254 None] Created reservations ['d57b76f6-a1ad-4bf0-8cf0-5cc1f1c4beb5', '4a930aaa-1303-4130-850d-d6745f1d2ec1', 'f6c583af-28b3-42e9-aaa3-cbc8c5c38246', '447aa57c-97cc-42ef-b398-d34ad77ae59b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:45:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4aed4255-9814-43e0-96c9-28f3462e520f tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4aed4255-9814-43e0-96c9-28f3462e520f tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4aed4255-9814-43e0-96c9-28f3462e520f tempest-VolumesSnapshotTestJSON-1895351254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4aed4255-9814-43e0-96c9-28f3462e520f tempest-VolumesSnapshotTestJSON-1895351254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4aed4255-9814-43e0-96c9-28f3462e520f tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4aed4255-9814-43e0-96c9-28f3462e520f tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:07 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:45:07 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:08 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8055ab54-1619-4765-8d0f-cfb110ad25bf" returned: 0 in 0.706s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] <== create_volume: return (1716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:45:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dbd5ec6-ec9e-4a55-8115-e539425fe3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8055ab54-1619-4765-8d0f-cfb110ad25bf', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e3aff3-f7a1-4ba9-b27b-6571e2cf932e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:08 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Volume volume-8055ab54-1619-4765-8d0f-cfb110ad25bf (8055ab54-1619-4765-8d0f-cfb110ad25bf): created successfully Jul 08 14:45:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25e3aff3-f7a1-4ba9-b27b-6571e2cf932e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Flow 'volume_create_manager' (95e75195-461d-4d3d-9d1f-34779b5677c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-911f120b-7d5f-4e52-b58d-cded787d9a98 tempest-CinderUnicodeTest-1200101885 None] Created volume successfully. Jul 08 14:45:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-61719274-7ce0-4f6e-968d-5a57baca682b tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "cinder-398d22df-ef82-4a16-8902-6a8f8c68d6ed-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-61719274-7ce0-4f6e-968d-5a57baca682b tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-398d22df-ef82-4a16-8902-6a8f8c68d6ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-61719274-7ce0-4f6e-968d-5a57baca682b tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "cinder-quobyte-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-61719274-7ce0-4f6e-968d-5a57baca682b tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-61719274-7ce0-4f6e-968d-5a57baca682b tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "cinder-quobyte-398d22df-ef82-4a16-8902-6a8f8c68d6ed" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-61719274-7ce0-4f6e-968d-5a57baca682b tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-398d22df-ef82-4a16-8902-6a8f8c68d6ed" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-61719274-7ce0-4f6e-968d-5a57baca682b tempest-VolumesSnapshotTestJSON-1895351254 None] Deleting offline snapshot 398d22df-ef82-4a16-8902-6a8f8c68d6ed of volume e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:45:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-61719274-7ce0-4f6e-968d-5a57baca682b tempest-VolumesSnapshotTestJSON-1895351254 None] snapshot_file for this snap is: volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.398d22df-ef82-4a16-8902-6a8f8c68d6ed {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:45:08 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b3905d-d81b-41bb-b0a2-da80d0e8db53]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-61719274-7ce0-4f6e-968d-5a57baca682b tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.398d22df-ef82-4a16-8902-6a8f8c68d6ed {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:08 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4aed4255-9814-43e0-96c9-28f3462e520f tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.679s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:08 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-4aed4255-9814-43e0-96c9-28f3462e520f tempest-VolumesSnapshotTestJSON-1895351254 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:45:08 devstack sudo[101859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.398d22df-ef82-4a16-8902-6a8f8c68d6ed Jul 08 14:45:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4aed4255-9814-43e0-96c9-28f3462e520f tempest-VolumesSnapshotTestJSON-1895351254 None] Deleted volume successfully. Jul 08 14:45:08 devstack sudo[101859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4aed4255-9814-43e0-96c9-28f3462e520f tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-6c879b9b-101b-43f5-87f1-312fd7bf5b03-delete_volume" released by "delete_volume" :: held 2.583s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:09 devstack sudo[101859]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-61719274-7ce0-4f6e-968d-5a57baca682b tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.398d22df-ef82-4a16-8902-6a8f8c68d6ed" returned: 0 in 0.942s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-61719274-7ce0-4f6e-968d-5a57baca682b tempest-VolumesSnapshotTestJSON-1895351254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4febf4-a9c8-49ca-80b1-d9098e4d045e]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-61719274-7ce0-4f6e-968d-5a57baca682b tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:09 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f Jul 08 14:45:09 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Flow 'volume_create_manager' (c1911c65-6347-4f80-afc9-d57f62204deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153dfa1e-1fe1-4000-849d-805336decd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (153dfa1e-1fe1-4000-849d-805336decd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1819976305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d688db1-a6e2-4698-ab8c-58546d9d99fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cbac4c90311402798b6595e6d9f3ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:10Z,use_quota=True,user_id='a64bd546d01041fbad49a0a2463112a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71ff7b3-55a4-48f0-82ce-5aa1c46422bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b71ff7b3-55a4-48f0-82ce-5aa1c46422bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f7d4d44-0b4e-46f5-8918-70bc5411d576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f7d4d44-0b4e-46f5-8918-70bc5411d576) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d688db1-a6e2-4698-ab8c-58546d9d99fa', 'volume_name': 'volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0890153-4ded-4b3d-b810-6526e7d5bbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0890153-4ded-4b3d-b810-6526e7d5bbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a667b310-f892-424b-a492-6c56ba441540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:09 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Volume 3d688db1-a6e2-4698-ab8c-58546d9d99fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa', 'volume_size': 1} Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1819976305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d688db1-a6e2-4698-ab8c-58546d9d99fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2cbac4c90311402798b6595e6d9f3ec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:10Z,use_quota=True,user_id='a64bd546d01041fbad49a0a2463112a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Creating volume 3d688db1-a6e2-4698-ab8c-58546d9d99fa {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:45:09 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:45:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:09 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa 1073741824 Jul 08 14:45:09 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:10 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-61719274-7ce0-4f6e-968d-5a57baca682b tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f" returned: 0 in 0.880s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-61719274-7ce0-4f6e-968d-5a57baca682b tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.398d22df-ef82-4a16-8902-6a8f8c68d6ed {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:10 devstack sudo[101872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.398d22df-ef82-4a16-8902-6a8f8c68d6ed Jul 08 14:45:10 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:10 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa 1073741824" returned: 0 in 1.055s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:11 devstack sudo[101878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa Jul 08 14:45:11 devstack sudo[101878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:11 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-61719274-7ce0-4f6e-968d-5a57baca682b tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.398d22df-ef82-4a16-8902-6a8f8c68d6ed" returned: 0 in 0.969s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-61719274-7ce0-4f6e-968d-5a57baca682b tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.398d22df-ef82-4a16-8902-6a8f8c68d6ed {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:11 devstack sudo[101884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.398d22df-ef82-4a16-8902-6a8f8c68d6ed Jul 08 14:45:11 devstack sudo[101884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:11 devstack sudo[101878]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa" returned: 0 in 0.851s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:45:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.963s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a667b310-f892-424b-a492-6c56ba441540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8682b0e4-44f6-4e7b-8150-231241c77b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:11 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Volume volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa (3d688db1-a6e2-4698-ab8c-58546d9d99fa): created successfully Jul 08 14:45:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8682b0e4-44f6-4e7b-8150-231241c77b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Flow 'volume_create_manager' (c1911c65-6347-4f80-afc9-d57f62204deb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:11 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-635a44e7-20ed-486d-9ed1-9026637abbf9 tempest-CinderUnicodeTest-1200101885 None] Created volume successfully. Jul 08 14:45:12 devstack sudo[101884]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-61719274-7ce0-4f6e-968d-5a57baca682b tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f.398d22df-ef82-4a16-8902-6a8f8c68d6ed" returned: 0 in 0.783s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-61719274-7ce0-4f6e-968d-5a57baca682b tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-398d22df-ef82-4a16-8902-6a8f8c68d6ed" released by "_delete_snapshot" :: held 3.714s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-61719274-7ce0-4f6e-968d-5a57baca682b tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f" released by "delete_snapshot" :: held 3.742s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:12 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-61719274-7ce0-4f6e-968d-5a57baca682b tempest-VolumesSnapshotTestJSON-1895351254 None] Created reservations ['805e9a37-e4dc-471b-a88e-40be39a21b89', '7f1c9a43-c708-4073-830c-c17265effbbe', '6e380e0a-e63b-4cc3-be3d-68e21ed3f1cd', '3de07d86-e49d-4bfb-9f9a-16d3e19ce9ee'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:45:12 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-61719274-7ce0-4f6e-968d-5a57baca682b tempest-VolumesSnapshotTestJSON-1895351254 None] Delete snapshot completed successfully. Jul 08 14:45:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-61719274-7ce0-4f6e-968d-5a57baca682b tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-398d22df-ef82-4a16-8902-6a8f8c68d6ed-delete_snapshot" released by "delete_snapshot" :: held 3.905s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d6305dbb-e132-4f13-85ac-dfb9ad65400e tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "cinder-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d6305dbb-e132-4f13-85ac-dfb9ad65400e tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d6305dbb-e132-4f13-85ac-dfb9ad65400e tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "cinder-quobyte-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d6305dbb-e132-4f13-85ac-dfb9ad65400e tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:13 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a71ef70-d1c5-4f7e-89df-9e790e7e5663]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d6305dbb-e132-4f13-85ac-dfb9ad65400e tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:13 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f Jul 08 14:45:13 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-349dd7ad-d4cb-4486-9336-e01b323f5d31 tempest-CinderUnicodeTest-1200101885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-349dd7ad-d4cb-4486-9336-e01b323f5d31 tempest-CinderUnicodeTest-1200101885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:13 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-349dd7ad-d4cb-4486-9336-e01b323f5d31 tempest-CinderUnicodeTest-1200101885 None] Creating offline snapshot 1cc3cfcc-cecd-446c-9de4-f429b86ecb7a of volume 3d688db1-a6e2-4698-ab8c-58546d9d99fa {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:45:13 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fdc5c5-ad74-438c-8e68-af5eb57c739d]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-349dd7ad-d4cb-4486-9336-e01b323f5d31 tempest-CinderUnicodeTest-1200101885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:13 devstack sudo[101890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa Jul 08 14:45:13 devstack sudo[101890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:14 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d6305dbb-e132-4f13-85ac-dfb9ad65400e tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f" returned: 0 in 0.961s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d6305dbb-e132-4f13-85ac-dfb9ad65400e tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:14 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f Jul 08 14:45:14 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:14 devstack sudo[101890]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-349dd7ad-d4cb-4486-9336-e01b323f5d31 tempest-CinderUnicodeTest-1200101885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa" returned: 0 in 0.857s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-349dd7ad-d4cb-4486-9336-e01b323f5d31 tempest-CinderUnicodeTest-1200101885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.1cc3cfcc-cecd-446c-9de4-f429b86ecb7a 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:14 devstack sudo[101903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.1cc3cfcc-cecd-446c-9de4-f429b86ecb7a 1G Jul 08 14:45:14 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:14 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d6305dbb-e132-4f13-85ac-dfb9ad65400e tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f" returned: 0 in 0.722s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:14 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d6305dbb-e132-4f13-85ac-dfb9ad65400e tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f" released by "delete_volume" :: held 1.784s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:14 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-d6305dbb-e132-4f13-85ac-dfb9ad65400e tempest-VolumesSnapshotTestJSON-1895351254 None] Created reservations ['bbe27336-2860-4160-9c34-4a6f6d94833e', '4430193b-f430-47f0-ab4b-19977011e610', '88957404-043b-4a2a-a6bc-d0d6287e9b9a', '2ff07baa-855a-461e-8357-9e1c721eef90'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:45:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d6305dbb-e132-4f13-85ac-dfb9ad65400e tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d6305dbb-e132-4f13-85ac-dfb9ad65400e tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d6305dbb-e132-4f13-85ac-dfb9ad65400e tempest-VolumesSnapshotTestJSON-1895351254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d6305dbb-e132-4f13-85ac-dfb9ad65400e tempest-VolumesSnapshotTestJSON-1895351254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d6305dbb-e132-4f13-85ac-dfb9ad65400e tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d6305dbb-e132-4f13-85ac-dfb9ad65400e tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:14 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:45:14 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:15 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-349dd7ad-d4cb-4486-9336-e01b323f5d31 tempest-CinderUnicodeTest-1200101885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.1cc3cfcc-cecd-446c-9de4-f429b86ecb7a 1G" returned: 0 in 0.904s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-349dd7ad-d4cb-4486-9336-e01b323f5d31 tempest-CinderUnicodeTest-1200101885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.1cc3cfcc-cecd-446c-9de4-f429b86ecb7a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:15 devstack sudo[101911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.1cc3cfcc-cecd-446c-9de4-f429b86ecb7a Jul 08 14:45:15 devstack sudo[101911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-064f814d-ad95-4178-9986-36bb39a54626 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "cinder-8c1d615a-6a87-417b-83a1-bb48672cd129-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-064f814d-ad95-4178-9986-36bb39a54626 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-8c1d615a-6a87-417b-83a1-bb48672cd129-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-064f814d-ad95-4178-9986-36bb39a54626 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "cinder-quobyte-8c1d615a-6a87-417b-83a1-bb48672cd129" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-064f814d-ad95-4178-9986-36bb39a54626 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-8c1d615a-6a87-417b-83a1-bb48672cd129" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:15 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a6400f-3869-4774-bc6e-c13c8d815c83]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-064f814d-ad95-4178-9986-36bb39a54626 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:15 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129 Jul 08 14:45:15 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:15 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d6305dbb-e132-4f13-85ac-dfb9ad65400e tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.760s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:15 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-d6305dbb-e132-4f13-85ac-dfb9ad65400e tempest-VolumesSnapshotTestJSON-1895351254 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:45:15 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d6305dbb-e132-4f13-85ac-dfb9ad65400e tempest-VolumesSnapshotTestJSON-1895351254 None] Deleted volume successfully. Jul 08 14:45:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d6305dbb-e132-4f13-85ac-dfb9ad65400e tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-e94e8ec5-3a66-4fb5-a12e-4aa2c709ac5f-delete_volume" released by "delete_volume" :: held 2.795s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:16 devstack sudo[101911]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-349dd7ad-d4cb-4486-9336-e01b323f5d31 tempest-CinderUnicodeTest-1200101885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.1cc3cfcc-cecd-446c-9de4-f429b86ecb7a" returned: 0 in 0.901s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:16 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-349dd7ad-d4cb-4486-9336-e01b323f5d31 tempest-CinderUnicodeTest-1200101885 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.1cc3cfcc-cecd-446c-9de4-f429b86ecb7a is being set with open permissions: ugo+rw Jul 08 14:45:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-349dd7ad-d4cb-4486-9336-e01b323f5d31 tempest-CinderUnicodeTest-1200101885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.1cc3cfcc-cecd-446c-9de4-f429b86ecb7a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:16 devstack sudo[101919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.1cc3cfcc-cecd-446c-9de4-f429b86ecb7a Jul 08 14:45:16 devstack sudo[101919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:16 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-064f814d-ad95-4178-9986-36bb39a54626 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129" returned: 0 in 0.938s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-064f814d-ad95-4178-9986-36bb39a54626 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:16 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129 Jul 08 14:45:16 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:16 devstack sudo[101919]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-349dd7ad-d4cb-4486-9336-e01b323f5d31 tempest-CinderUnicodeTest-1200101885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.1cc3cfcc-cecd-446c-9de4-f429b86ecb7a" returned: 0 in 0.736s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-349dd7ad-d4cb-4486-9336-e01b323f5d31 tempest-CinderUnicodeTest-1200101885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:16 devstack sudo[101931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.info Jul 08 14:45:16 devstack sudo[101931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-8f1f3385-ba76-4e74-a0dd-56f3b0556f67 req-dacc137d-221a-4693-95f8-da9a3483b9d1 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:17 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-064f814d-ad95-4178-9986-36bb39a54626 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8c1d615a-6a87-417b-83a1-bb48672cd129" returned: 0 in 0.737s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-064f814d-ad95-4178-9986-36bb39a54626 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-quobyte-8c1d615a-6a87-417b-83a1-bb48672cd129" released by "delete_volume" :: held 1.759s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:17 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-064f814d-ad95-4178-9986-36bb39a54626 tempest-VolumesSnapshotTestJSON-1895351254 None] Created reservations ['42b4f0a7-1353-4e4c-9881-53675e5fe8a3', 'bb85ab29-7032-4bce-86d9-5b4a358048b9', '32159537-b4f1-4102-b8b8-80c059b89090', '9e368e3a-4719-4f11-b0b5-f583ee41d000'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:45:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-064f814d-ad95-4178-9986-36bb39a54626 tempest-VolumesSnapshotTestJSON-1895351254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-064f814d-ad95-4178-9986-36bb39a54626 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-064f814d-ad95-4178-9986-36bb39a54626 tempest-VolumesSnapshotTestJSON-1895351254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-064f814d-ad95-4178-9986-36bb39a54626 tempest-VolumesSnapshotTestJSON-1895351254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-064f814d-ad95-4178-9986-36bb39a54626 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-064f814d-ad95-4178-9986-36bb39a54626 tempest-VolumesSnapshotTestJSON-1895351254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:17 devstack sudo[101938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:45:17 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:17 devstack sudo[101931]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-349dd7ad-d4cb-4486-9336-e01b323f5d31 tempest-CinderUnicodeTest-1200101885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.info" returned: 0 in 0.730s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:17 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-349dd7ad-d4cb-4486-9336-e01b323f5d31 tempest-CinderUnicodeTest-1200101885 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.info is being set with open permissions: ugo+rw Jul 08 14:45:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-349dd7ad-d4cb-4486-9336-e01b323f5d31 tempest-CinderUnicodeTest-1200101885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:17 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.info Jul 08 14:45:17 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:18 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-064f814d-ad95-4178-9986-36bb39a54626 tempest-VolumesSnapshotTestJSON-1895351254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.776s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:18 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-064f814d-ad95-4178-9986-36bb39a54626 tempest-VolumesSnapshotTestJSON-1895351254 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:45:18 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-064f814d-ad95-4178-9986-36bb39a54626 tempest-VolumesSnapshotTestJSON-1895351254 None] Deleted volume successfully. Jul 08 14:45:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-064f814d-ad95-4178-9986-36bb39a54626 tempest-VolumesSnapshotTestJSON-1895351254 None] Lock "cinder-8c1d615a-6a87-417b-83a1-bb48672cd129-delete_volume" released by "delete_volume" :: held 2.791s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:18 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-349dd7ad-d4cb-4486-9336-e01b323f5d31 tempest-CinderUnicodeTest-1200101885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.info" returned: 0 in 0.684s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-349dd7ad-d4cb-4486-9336-e01b323f5d31 tempest-CinderUnicodeTest-1200101885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.926s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-8f1f3385-ba76-4e74-a0dd-56f3b0556f67 req-dacc137d-221a-4693-95f8-da9a3483b9d1 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.260s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:18 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[93546e59-7e3f-425b-b294-e16372f727c7]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-8f1f3385-ba76-4e74-a0dd-56f3b0556f67 req-dacc137d-221a-4693-95f8-da9a3483b9d1 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4df2db87-25a7-4fde-ab62-9f989c59ad48 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:18 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-349dd7ad-d4cb-4486-9336-e01b323f5d31 tempest-CinderUnicodeTest-1200101885 None] Create snapshot completed successfully Jul 08 14:45:18 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4df2db87-25a7-4fde-ab62-9f989c59ad48 Jul 08 14:45:18 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d40df05b-4c0b-45f4-a356-d2062cd88cc0 tempest-CinderUnicodeTest-1200101885 None] Acquiring lock "cinder-1cc3cfcc-cecd-446c-9de4-f429b86ecb7a-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d40df05b-4c0b-45f4-a356-d2062cd88cc0 tempest-CinderUnicodeTest-1200101885 None] Lock "cinder-1cc3cfcc-cecd-446c-9de4-f429b86ecb7a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d40df05b-4c0b-45f4-a356-d2062cd88cc0 tempest-CinderUnicodeTest-1200101885 None] Acquiring lock "cinder-quobyte-3d688db1-a6e2-4698-ab8c-58546d9d99fa" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d40df05b-4c0b-45f4-a356-d2062cd88cc0 tempest-CinderUnicodeTest-1200101885 None] Lock "cinder-quobyte-3d688db1-a6e2-4698-ab8c-58546d9d99fa" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d40df05b-4c0b-45f4-a356-d2062cd88cc0 tempest-CinderUnicodeTest-1200101885 None] Acquiring lock "cinder-quobyte-1cc3cfcc-cecd-446c-9de4-f429b86ecb7a" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d40df05b-4c0b-45f4-a356-d2062cd88cc0 tempest-CinderUnicodeTest-1200101885 None] Lock "cinder-quobyte-1cc3cfcc-cecd-446c-9de4-f429b86ecb7a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d40df05b-4c0b-45f4-a356-d2062cd88cc0 tempest-CinderUnicodeTest-1200101885 None] Deleting offline snapshot 1cc3cfcc-cecd-446c-9de4-f429b86ecb7a of volume 3d688db1-a6e2-4698-ab8c-58546d9d99fa {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:45:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d40df05b-4c0b-45f4-a356-d2062cd88cc0 tempest-CinderUnicodeTest-1200101885 None] snapshot_file for this snap is: volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.1cc3cfcc-cecd-446c-9de4-f429b86ecb7a {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:45:18 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ada737-744a-4bd6-a995-0df34df7197d]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d40df05b-4c0b-45f4-a356-d2062cd88cc0 tempest-CinderUnicodeTest-1200101885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.1cc3cfcc-cecd-446c-9de4-f429b86ecb7a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:19 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.1cc3cfcc-cecd-446c-9de4-f429b86ecb7a Jul 08 14:45:19 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:19 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-8f1f3385-ba76-4e74-a0dd-56f3b0556f67 req-dacc137d-221a-4693-95f8-da9a3483b9d1 tempest-TestServerVolumeAttachmentScenario-1132260277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4df2db87-25a7-4fde-ab62-9f989c59ad48" returned: 0 in 0.967s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-8f1f3385-ba76-4e74-a0dd-56f3b0556f67 req-dacc137d-221a-4693-95f8-da9a3483b9d1 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.990s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-8f1f3385-ba76-4e74-a0dd-56f3b0556f67 req-dacc137d-221a-4693-95f8-da9a3483b9d1 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad', 'name': 'volume-4df2db87-25a7-4fde-ab62-9f989c59ad48', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ccbc5f3-27bd-4da1-bf33-6601e23f5491', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:45:19 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-8f1f3385-ba76-4e74-a0dd-56f3b0556f67 req-dacc137d-221a-4693-95f8-da9a3483b9d1 tempest-TestServerVolumeAttachmentScenario-1132260277 None] attachment_update completed successfully. Jul 08 14:45:19 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d40df05b-4c0b-45f4-a356-d2062cd88cc0 tempest-CinderUnicodeTest-1200101885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.1cc3cfcc-cecd-446c-9de4-f429b86ecb7a" returned: 0 in 1.022s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-d40df05b-4c0b-45f4-a356-d2062cd88cc0 tempest-CinderUnicodeTest-1200101885 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:45:20 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5126f1b4-3a70-4d22-bdcf-276b98cf343a]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d40df05b-4c0b-45f4-a356-d2062cd88cc0 tempest-CinderUnicodeTest-1200101885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:20 devstack sudo[101959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa Jul 08 14:45:20 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:20 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d40df05b-4c0b-45f4-a356-d2062cd88cc0 tempest-CinderUnicodeTest-1200101885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa" returned: 0 in 0.988s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d40df05b-4c0b-45f4-a356-d2062cd88cc0 tempest-CinderUnicodeTest-1200101885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.1cc3cfcc-cecd-446c-9de4-f429b86ecb7a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:21 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.1cc3cfcc-cecd-446c-9de4-f429b86ecb7a Jul 08 14:45:21 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:21 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d40df05b-4c0b-45f4-a356-d2062cd88cc0 tempest-CinderUnicodeTest-1200101885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.1cc3cfcc-cecd-446c-9de4-f429b86ecb7a" returned: 0 in 0.881s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d40df05b-4c0b-45f4-a356-d2062cd88cc0 tempest-CinderUnicodeTest-1200101885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.1cc3cfcc-cecd-446c-9de4-f429b86ecb7a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:21 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.1cc3cfcc-cecd-446c-9de4-f429b86ecb7a Jul 08 14:45:21 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:22 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d40df05b-4c0b-45f4-a356-d2062cd88cc0 tempest-CinderUnicodeTest-1200101885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa.1cc3cfcc-cecd-446c-9de4-f429b86ecb7a" returned: 0 in 0.796s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d40df05b-4c0b-45f4-a356-d2062cd88cc0 tempest-CinderUnicodeTest-1200101885 None] Lock "cinder-quobyte-1cc3cfcc-cecd-446c-9de4-f429b86ecb7a" released by "_delete_snapshot" :: held 3.847s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d40df05b-4c0b-45f4-a356-d2062cd88cc0 tempest-CinderUnicodeTest-1200101885 None] Lock "cinder-quobyte-3d688db1-a6e2-4698-ab8c-58546d9d99fa" released by "delete_snapshot" :: held 3.871s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:22 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-d40df05b-4c0b-45f4-a356-d2062cd88cc0 tempest-CinderUnicodeTest-1200101885 None] Created reservations ['84c9a1df-8d48-4c49-b729-f5da6cd84692', '85b8178f-250a-428c-9b1e-c4179f621023', '7dfe78fb-eeac-4afb-a4ba-31af944a177c', 'f86d6f4b-a851-45fe-9f3f-c02c7ada182a'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:45:22 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d40df05b-4c0b-45f4-a356-d2062cd88cc0 tempest-CinderUnicodeTest-1200101885 None] Delete snapshot completed successfully. Jul 08 14:45:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d40df05b-4c0b-45f4-a356-d2062cd88cc0 tempest-CinderUnicodeTest-1200101885 None] Lock "cinder-1cc3cfcc-cecd-446c-9de4-f429b86ecb7a-delete_snapshot" released by "delete_snapshot" :: held 4.041s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2a452ce1-b9b4-47e1-ae07-047c7ee8d484 tempest-CinderUnicodeTest-1200101885 None] Acquiring lock "cinder-3d688db1-a6e2-4698-ab8c-58546d9d99fa-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2a452ce1-b9b4-47e1-ae07-047c7ee8d484 tempest-CinderUnicodeTest-1200101885 None] Lock "cinder-3d688db1-a6e2-4698-ab8c-58546d9d99fa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2a452ce1-b9b4-47e1-ae07-047c7ee8d484 tempest-CinderUnicodeTest-1200101885 None] Acquiring lock "cinder-quobyte-3d688db1-a6e2-4698-ab8c-58546d9d99fa" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2a452ce1-b9b4-47e1-ae07-047c7ee8d484 tempest-CinderUnicodeTest-1200101885 None] Lock "cinder-quobyte-3d688db1-a6e2-4698-ab8c-58546d9d99fa" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:23 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ec2bbf-0e1a-41db-a3b7-7ecaa7920cde]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2a452ce1-b9b4-47e1-ae07-047c7ee8d484 tempest-CinderUnicodeTest-1200101885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:23 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa Jul 08 14:45:23 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:24 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2a452ce1-b9b4-47e1-ae07-047c7ee8d484 tempest-CinderUnicodeTest-1200101885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa" returned: 0 in 0.880s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2a452ce1-b9b4-47e1-ae07-047c7ee8d484 tempest-CinderUnicodeTest-1200101885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:24 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa Jul 08 14:45:24 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:24 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-d6a691b6-aa4a-4b68-b881-644ecc9a7476 req-b7cbc143-9559-4fd5-b135-c9fb79f5e065 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Terminate volume connection completed successfully. Jul 08 14:45:24 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-d6a691b6-aa4a-4b68-b881-644ecc9a7476 req-b7cbc143-9559-4fd5-b135-c9fb79f5e065 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Deleting attachment 9ccbc5f3-27bd-4da1-bf33-6601e23f5491. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:45:25 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2a452ce1-b9b4-47e1-ae07-047c7ee8d484 tempest-CinderUnicodeTest-1200101885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3d688db1-a6e2-4698-ab8c-58546d9d99fa" returned: 0 in 0.846s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2a452ce1-b9b4-47e1-ae07-047c7ee8d484 tempest-CinderUnicodeTest-1200101885 None] Lock "cinder-quobyte-3d688db1-a6e2-4698-ab8c-58546d9d99fa" released by "delete_volume" :: held 1.803s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:25 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-2a452ce1-b9b4-47e1-ae07-047c7ee8d484 tempest-CinderUnicodeTest-1200101885 None] Created reservations ['48ce50fb-4a5c-4eca-87ef-9cf819dcf1ab', '7222d348-f1ef-4ec8-9f8a-72988a846136', 'c65bf414-14da-4b76-8a52-4226a2ae6ed0', '679270c1-d012-493e-a8bc-0251891c6e03'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:45:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2a452ce1-b9b4-47e1-ae07-047c7ee8d484 tempest-CinderUnicodeTest-1200101885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2a452ce1-b9b4-47e1-ae07-047c7ee8d484 tempest-CinderUnicodeTest-1200101885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2a452ce1-b9b4-47e1-ae07-047c7ee8d484 tempest-CinderUnicodeTest-1200101885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2a452ce1-b9b4-47e1-ae07-047c7ee8d484 tempest-CinderUnicodeTest-1200101885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2a452ce1-b9b4-47e1-ae07-047c7ee8d484 tempest-CinderUnicodeTest-1200101885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2a452ce1-b9b4-47e1-ae07-047c7ee8d484 tempest-CinderUnicodeTest-1200101885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:25 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:45:25 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b7ac931c-6dba-43d7-bf30-3b41ce164e3c tempest-CinderUnicodeTest-1200101885 None] Acquiring lock "cinder-8055ab54-1619-4765-8d0f-cfb110ad25bf-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b7ac931c-6dba-43d7-bf30-3b41ce164e3c tempest-CinderUnicodeTest-1200101885 None] Lock "cinder-8055ab54-1619-4765-8d0f-cfb110ad25bf-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b7ac931c-6dba-43d7-bf30-3b41ce164e3c tempest-CinderUnicodeTest-1200101885 None] Acquiring lock "cinder-quobyte-8055ab54-1619-4765-8d0f-cfb110ad25bf" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b7ac931c-6dba-43d7-bf30-3b41ce164e3c tempest-CinderUnicodeTest-1200101885 None] Lock "cinder-quobyte-8055ab54-1619-4765-8d0f-cfb110ad25bf" acquired by "delete_volume" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:25 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe30eba-25c9-4eab-a3e3-e45c04c2b001]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b7ac931c-6dba-43d7-bf30-3b41ce164e3c tempest-CinderUnicodeTest-1200101885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8055ab54-1619-4765-8d0f-cfb110ad25bf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:25 devstack sudo[101986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8055ab54-1619-4765-8d0f-cfb110ad25bf Jul 08 14:45:25 devstack sudo[101986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:26 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2a452ce1-b9b4-47e1-ae07-047c7ee8d484 tempest-CinderUnicodeTest-1200101885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.959s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:26 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-2a452ce1-b9b4-47e1-ae07-047c7ee8d484 tempest-CinderUnicodeTest-1200101885 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:45:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2a452ce1-b9b4-47e1-ae07-047c7ee8d484 tempest-CinderUnicodeTest-1200101885 None] Deleted volume successfully. Jul 08 14:45:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2a452ce1-b9b4-47e1-ae07-047c7ee8d484 tempest-CinderUnicodeTest-1200101885 None] Lock "cinder-3d688db1-a6e2-4698-ab8c-58546d9d99fa-delete_volume" released by "delete_volume" :: held 3.042s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:26 devstack sudo[101986]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b7ac931c-6dba-43d7-bf30-3b41ce164e3c tempest-CinderUnicodeTest-1200101885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8055ab54-1619-4765-8d0f-cfb110ad25bf" returned: 0 in 1.083s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b7ac931c-6dba-43d7-bf30-3b41ce164e3c tempest-CinderUnicodeTest-1200101885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8055ab54-1619-4765-8d0f-cfb110ad25bf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:26 devstack sudo[101992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8055ab54-1619-4765-8d0f-cfb110ad25bf Jul 08 14:45:26 devstack sudo[101992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:27 devstack sudo[101992]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b7ac931c-6dba-43d7-bf30-3b41ce164e3c tempest-CinderUnicodeTest-1200101885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8055ab54-1619-4765-8d0f-cfb110ad25bf" returned: 0 in 0.753s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b7ac931c-6dba-43d7-bf30-3b41ce164e3c tempest-CinderUnicodeTest-1200101885 None] Lock "cinder-quobyte-8055ab54-1619-4765-8d0f-cfb110ad25bf" released by "delete_volume" :: held 1.915s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:27 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-b7ac931c-6dba-43d7-bf30-3b41ce164e3c tempest-CinderUnicodeTest-1200101885 None] Created reservations ['68073141-3416-4f0c-9ad2-0d68ea7079a3', '67505450-6340-40e2-a9f3-2da1bb0ec268', 'e4f7af0b-8d66-4b8f-909e-d06c7ce4f68b', 'd05bef8d-8c97-4d30-9dc5-4dca20a15648'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:45:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b7ac931c-6dba-43d7-bf30-3b41ce164e3c tempest-CinderUnicodeTest-1200101885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b7ac931c-6dba-43d7-bf30-3b41ce164e3c tempest-CinderUnicodeTest-1200101885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b7ac931c-6dba-43d7-bf30-3b41ce164e3c tempest-CinderUnicodeTest-1200101885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b7ac931c-6dba-43d7-bf30-3b41ce164e3c tempest-CinderUnicodeTest-1200101885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b7ac931c-6dba-43d7-bf30-3b41ce164e3c tempest-CinderUnicodeTest-1200101885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b7ac931c-6dba-43d7-bf30-3b41ce164e3c tempest-CinderUnicodeTest-1200101885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:27 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:45:27 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:28 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b7ac931c-6dba-43d7-bf30-3b41ce164e3c tempest-CinderUnicodeTest-1200101885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.732s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:28 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-b7ac931c-6dba-43d7-bf30-3b41ce164e3c tempest-CinderUnicodeTest-1200101885 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:45:28 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b7ac931c-6dba-43d7-bf30-3b41ce164e3c tempest-CinderUnicodeTest-1200101885 None] Deleted volume successfully. Jul 08 14:45:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b7ac931c-6dba-43d7-bf30-3b41ce164e3c tempest-CinderUnicodeTest-1200101885 None] Lock "cinder-8055ab54-1619-4765-8d0f-cfb110ad25bf-delete_volume" released by "delete_volume" :: held 2.967s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:28 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-fb2a9c03-cb14-4393-b38e-9b4af5359b10 req-f9f8c80e-a4e0-4db1-94a7-80c9b4f239fc tempest-TestServerVolumeAttachmentScenario-1132260277 None] Terminate volume connection completed successfully. Jul 08 14:45:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-fb2a9c03-cb14-4393-b38e-9b4af5359b10 req-f9f8c80e-a4e0-4db1-94a7-80c9b4f239fc tempest-TestServerVolumeAttachmentScenario-1132260277 None] Deleting attachment c40bd934-9077-41b5-b8bb-b3f739a4aad4. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:45:32 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:45:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Flow 'volume_create_manager' (f5ef6c50-02bb-413e-9882-b026611d71e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee04953a-bca6-407c-91f3-d2a0d83a166f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee04953a-bca6-407c-91f3-d2a0d83a166f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2122016057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f758364-fb2f-4688-88c1-6002a614e439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac60af4324794c4094992f37d13dc0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:33Z,use_quota=True,user_id='e129aa06c5f44fceb1fc9ba54533cd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261f8cc7-73a6-4061-85b8-4cbe53d8bf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261f8cc7-73a6-4061-85b8-4cbe53d8bf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282e7daf-9fe6-4d55-885c-f644c2fdf5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282e7daf-9fe6-4d55-885c-f644c2fdf5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f758364-fb2f-4688-88c1-6002a614e439', 'volume_name': 'volume-3f758364-fb2f-4688-88c1-6002a614e439', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898514be-b1c2-4a93-b220-2db166095c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (898514be-b1c2-4a93-b220-2db166095c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824c4279-bfff-44ed-aeb8-06c61bd8b933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:32 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Volume 3f758364-fb2f-4688-88c1-6002a614e439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f758364-fb2f-4688-88c1-6002a614e439', 'volume_size': 1} Jul 08 14:45:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2122016057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f758364-fb2f-4688-88c1-6002a614e439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac60af4324794c4094992f37d13dc0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:33Z,use_quota=True,user_id='e129aa06c5f44fceb1fc9ba54533cd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:45:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Creating volume 3f758364-fb2f-4688-88c1-6002a614e439 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:45:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:45:32 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:45:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f758364-fb2f-4688-88c1-6002a614e439 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:32 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f758364-fb2f-4688-88c1-6002a614e439 1073741824 Jul 08 14:45:32 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:34 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f758364-fb2f-4688-88c1-6002a614e439 1073741824" returned: 0 in 1.277s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:34 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=86,cinder:DELETE=8,cinder:UPDATE=93,cinder:INSERT=29 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:45:34 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=116,cinder:SELECT=104,cinder:INSERT=31,cinder:DELETE=8 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:45:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f758364-fb2f-4688-88c1-6002a614e439 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:34 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f758364-fb2f-4688-88c1-6002a614e439 Jul 08 14:45:34 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:34 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f758364-fb2f-4688-88c1-6002a614e439" returned: 0 in 0.903s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] <== create_volume: return (2260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:45:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.265s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824c4279-bfff-44ed-aeb8-06c61bd8b933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f758364-fb2f-4688-88c1-6002a614e439', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be2ce67-43db-4a44-bdb6-0974a7a3a54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:35 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Volume volume-3f758364-fb2f-4688-88c1-6002a614e439 (3f758364-fb2f-4688-88c1-6002a614e439): created successfully Jul 08 14:45:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9be2ce67-43db-4a44-bdb6-0974a7a3a54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Flow 'volume_create_manager' (f5ef6c50-02bb-413e-9882-b026611d71e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:35 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3164f81a-67a6-4d35-83a0-bbd9b8061cb4 tempest-ProjectReaderTests-1471446188 None] Created volume successfully. Jul 08 14:45:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bf02f33-dd58-4aa3-949b-ff20f7e62fff tempest-ProjectReaderTests-1471446188 None] Acquiring lock "cinder-3f758364-fb2f-4688-88c1-6002a614e439-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bf02f33-dd58-4aa3-949b-ff20f7e62fff tempest-ProjectReaderTests-1471446188 None] Lock "cinder-3f758364-fb2f-4688-88c1-6002a614e439-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bf02f33-dd58-4aa3-949b-ff20f7e62fff tempest-ProjectReaderTests-1471446188 None] Acquiring lock "cinder-quobyte-3f758364-fb2f-4688-88c1-6002a614e439" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bf02f33-dd58-4aa3-949b-ff20f7e62fff tempest-ProjectReaderTests-1471446188 None] Lock "cinder-quobyte-3f758364-fb2f-4688-88c1-6002a614e439" acquired by "delete_volume" :: waited 0.041s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:36 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc6a3d4-512c-4a61-ac50-9379848f9dff]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bf02f33-dd58-4aa3-949b-ff20f7e62fff tempest-ProjectReaderTests-1471446188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f758364-fb2f-4688-88c1-6002a614e439 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:36 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f758364-fb2f-4688-88c1-6002a614e439 Jul 08 14:45:36 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:37 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bf02f33-dd58-4aa3-949b-ff20f7e62fff tempest-ProjectReaderTests-1471446188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f758364-fb2f-4688-88c1-6002a614e439" returned: 0 in 1.127s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bf02f33-dd58-4aa3-949b-ff20f7e62fff tempest-ProjectReaderTests-1471446188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f758364-fb2f-4688-88c1-6002a614e439 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:37 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f758364-fb2f-4688-88c1-6002a614e439 Jul 08 14:45:37 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:38 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bf02f33-dd58-4aa3-949b-ff20f7e62fff tempest-ProjectReaderTests-1471446188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3f758364-fb2f-4688-88c1-6002a614e439" returned: 0 in 0.899s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bf02f33-dd58-4aa3-949b-ff20f7e62fff tempest-ProjectReaderTests-1471446188 None] Lock "cinder-quobyte-3f758364-fb2f-4688-88c1-6002a614e439" released by "delete_volume" :: held 2.086s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:38 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-2bf02f33-dd58-4aa3-949b-ff20f7e62fff tempest-ProjectReaderTests-1471446188 None] Created reservations ['90d3017e-096e-4931-843d-6437614f6470', '0ae0a5cd-7e95-4cb1-bcea-d0dd77ef59ac', '534bee3b-eb6a-4196-970e-fdcdf44d79c3', '354a9815-5cce-40ff-858f-4bf82cc65c87'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:45:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2bf02f33-dd58-4aa3-949b-ff20f7e62fff tempest-ProjectReaderTests-1471446188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2bf02f33-dd58-4aa3-949b-ff20f7e62fff tempest-ProjectReaderTests-1471446188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2bf02f33-dd58-4aa3-949b-ff20f7e62fff tempest-ProjectReaderTests-1471446188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2bf02f33-dd58-4aa3-949b-ff20f7e62fff tempest-ProjectReaderTests-1471446188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2bf02f33-dd58-4aa3-949b-ff20f7e62fff tempest-ProjectReaderTests-1471446188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bf02f33-dd58-4aa3-949b-ff20f7e62fff tempest-ProjectReaderTests-1471446188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:38 devstack sudo[102067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:45:38 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:39 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2bf02f33-dd58-4aa3-949b-ff20f7e62fff tempest-ProjectReaderTests-1471446188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.958s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:39 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-2bf02f33-dd58-4aa3-949b-ff20f7e62fff tempest-ProjectReaderTests-1471446188 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:45:39 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2bf02f33-dd58-4aa3-949b-ff20f7e62fff tempest-ProjectReaderTests-1471446188 None] Deleted volume successfully. Jul 08 14:45:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2bf02f33-dd58-4aa3-949b-ff20f7e62fff tempest-ProjectReaderTests-1471446188 None] Lock "cinder-3f758364-fb2f-4688-88c1-6002a614e439-delete_volume" released by "delete_volume" :: held 3.489s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:40 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:45:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Flow 'volume_create_manager' (0e4ab2f9-339c-4cf6-b62d-d384ecc32b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4662f62b-16d2-4be1-b598-748fbeff28af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4662f62b-16d2-4be1-b598-748fbeff28af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1442164738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1185f3b2-7d54-4657-89a3-1154428b9f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac60af4324794c4094992f37d13dc0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:40Z,use_quota=True,user_id='e129aa06c5f44fceb1fc9ba54533cd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63df6dd-167f-4a6a-9679-5c524e7e5b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f63df6dd-167f-4a6a-9679-5c524e7e5b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (882210aa-9895-434d-8c01-284cd47acf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (882210aa-9895-434d-8c01-284cd47acf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1185f3b2-7d54-4657-89a3-1154428b9f41', 'volume_name': 'volume-1185f3b2-7d54-4657-89a3-1154428b9f41', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02db022a-505e-43fe-882e-37fb61b074e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02db022a-505e-43fe-882e-37fb61b074e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26476554-9148-4a94-b16c-3e1bfbe05846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:40 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Volume 1185f3b2-7d54-4657-89a3-1154428b9f41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1185f3b2-7d54-4657-89a3-1154428b9f41', 'volume_size': 1} Jul 08 14:45:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1442164738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1185f3b2-7d54-4657-89a3-1154428b9f41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac60af4324794c4094992f37d13dc0f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:45:40Z,use_quota=True,user_id='e129aa06c5f44fceb1fc9ba54533cd90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:45:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Creating volume 1185f3b2-7d54-4657-89a3-1154428b9f41 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:45:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:45:40 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:45:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1185f3b2-7d54-4657-89a3-1154428b9f41 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:40 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1185f3b2-7d54-4657-89a3-1154428b9f41 1073741824 Jul 08 14:45:40 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:41 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1185f3b2-7d54-4657-89a3-1154428b9f41 1073741824" returned: 0 in 1.044s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1185f3b2-7d54-4657-89a3-1154428b9f41 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:41 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1185f3b2-7d54-4657-89a3-1154428b9f41 Jul 08 14:45:41 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:42 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1185f3b2-7d54-4657-89a3-1154428b9f41" returned: 0 in 0.813s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] <== create_volume: return (1906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:45:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26476554-9148-4a94-b16c-3e1bfbe05846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1185f3b2-7d54-4657-89a3-1154428b9f41', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06970dbd-eafb-42f1-a506-0097ed264bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:45:42 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Volume volume-1185f3b2-7d54-4657-89a3-1154428b9f41 (1185f3b2-7d54-4657-89a3-1154428b9f41): created successfully Jul 08 14:45:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06970dbd-eafb-42f1-a506-0097ed264bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:45:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Flow 'volume_create_manager' (0e4ab2f9-339c-4cf6-b62d-d384ecc32b38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:45:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-95fab77a-9ae7-4736-a2e1-dd034bc586c5 tempest-ProjectReaderTests-1471446188 None] Created volume successfully. Jul 08 14:45:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d69e0f8f-4870-48c9-a565-4f2b4be63053 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Acquiring lock "cinder-4df2db87-25a7-4fde-ab62-9f989c59ad48-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d69e0f8f-4870-48c9-a565-4f2b4be63053 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "cinder-4df2db87-25a7-4fde-ab62-9f989c59ad48-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d69e0f8f-4870-48c9-a565-4f2b4be63053 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Acquiring lock "cinder-quobyte-4df2db87-25a7-4fde-ab62-9f989c59ad48" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d69e0f8f-4870-48c9-a565-4f2b4be63053 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "cinder-quobyte-4df2db87-25a7-4fde-ab62-9f989c59ad48" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:42 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af6c0c8-4205-4ba7-912b-31f0a372a70d]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d69e0f8f-4870-48c9-a565-4f2b4be63053 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4df2db87-25a7-4fde-ab62-9f989c59ad48 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:43 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4df2db87-25a7-4fde-ab62-9f989c59ad48 Jul 08 14:45:43 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-89f6ccc0-d67c-4d16-91b1-b7a13dc0628c tempest-ProjectReaderTests-1471446188 None] Acquiring lock "cinder-1185f3b2-7d54-4657-89a3-1154428b9f41-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-89f6ccc0-d67c-4d16-91b1-b7a13dc0628c tempest-ProjectReaderTests-1471446188 None] Lock "cinder-1185f3b2-7d54-4657-89a3-1154428b9f41-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-89f6ccc0-d67c-4d16-91b1-b7a13dc0628c tempest-ProjectReaderTests-1471446188 None] Acquiring lock "cinder-quobyte-1185f3b2-7d54-4657-89a3-1154428b9f41" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-89f6ccc0-d67c-4d16-91b1-b7a13dc0628c tempest-ProjectReaderTests-1471446188 None] Lock "cinder-quobyte-1185f3b2-7d54-4657-89a3-1154428b9f41" acquired by "delete_volume" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:43 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c0283a-f96f-4726-a079-2176f150231b]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89f6ccc0-d67c-4d16-91b1-b7a13dc0628c tempest-ProjectReaderTests-1471446188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1185f3b2-7d54-4657-89a3-1154428b9f41 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:43 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1185f3b2-7d54-4657-89a3-1154428b9f41 Jul 08 14:45:43 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:43 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d69e0f8f-4870-48c9-a565-4f2b4be63053 tempest-TestServerVolumeAttachmentScenario-1132260277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4df2db87-25a7-4fde-ab62-9f989c59ad48" returned: 0 in 1.029s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d69e0f8f-4870-48c9-a565-4f2b4be63053 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4df2db87-25a7-4fde-ab62-9f989c59ad48 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:44 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4df2db87-25a7-4fde-ab62-9f989c59ad48 Jul 08 14:45:44 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:44 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89f6ccc0-d67c-4d16-91b1-b7a13dc0628c tempest-ProjectReaderTests-1471446188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1185f3b2-7d54-4657-89a3-1154428b9f41" returned: 0 in 1.047s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89f6ccc0-d67c-4d16-91b1-b7a13dc0628c tempest-ProjectReaderTests-1471446188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1185f3b2-7d54-4657-89a3-1154428b9f41 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:44 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1185f3b2-7d54-4657-89a3-1154428b9f41 Jul 08 14:45:44 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:45 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d69e0f8f-4870-48c9-a565-4f2b4be63053 tempest-TestServerVolumeAttachmentScenario-1132260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-4df2db87-25a7-4fde-ab62-9f989c59ad48" returned: 0 in 1.113s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d69e0f8f-4870-48c9-a565-4f2b4be63053 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "cinder-quobyte-4df2db87-25a7-4fde-ab62-9f989c59ad48" released by "delete_volume" :: held 2.196s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:45 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-d69e0f8f-4870-48c9-a565-4f2b4be63053 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Created reservations ['813e68e1-1870-4a14-941f-887e7222c5ff', '43da3365-67b8-43cc-8b88-5a601702f65b', '93e2f9d2-9ef0-491b-8619-2dd2b665e292', '6d2e68f5-e514-42c2-9697-3d73159f3db4'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:45:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d69e0f8f-4870-48c9-a565-4f2b4be63053 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d69e0f8f-4870-48c9-a565-4f2b4be63053 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d69e0f8f-4870-48c9-a565-4f2b4be63053 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d69e0f8f-4870-48c9-a565-4f2b4be63053 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d69e0f8f-4870-48c9-a565-4f2b4be63053 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d69e0f8f-4870-48c9-a565-4f2b4be63053 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:45 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:45:45 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:45 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89f6ccc0-d67c-4d16-91b1-b7a13dc0628c tempest-ProjectReaderTests-1471446188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1185f3b2-7d54-4657-89a3-1154428b9f41" returned: 0 in 0.985s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-89f6ccc0-d67c-4d16-91b1-b7a13dc0628c tempest-ProjectReaderTests-1471446188 None] Lock "cinder-quobyte-1185f3b2-7d54-4657-89a3-1154428b9f41" released by "delete_volume" :: held 2.099s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:45 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-89f6ccc0-d67c-4d16-91b1-b7a13dc0628c tempest-ProjectReaderTests-1471446188 None] Created reservations ['28732de7-f350-4500-828b-f78f8dcba50c', 'b846ce8a-c05a-4cd9-9eff-5f774c5bb059', 'c856702f-5834-48e4-8590-a6df14fa57f5', '73845cd9-6542-4fc3-831a-49a873a51c04'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:45:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-89f6ccc0-d67c-4d16-91b1-b7a13dc0628c tempest-ProjectReaderTests-1471446188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-89f6ccc0-d67c-4d16-91b1-b7a13dc0628c tempest-ProjectReaderTests-1471446188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-89f6ccc0-d67c-4d16-91b1-b7a13dc0628c tempest-ProjectReaderTests-1471446188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-89f6ccc0-d67c-4d16-91b1-b7a13dc0628c tempest-ProjectReaderTests-1471446188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-89f6ccc0-d67c-4d16-91b1-b7a13dc0628c tempest-ProjectReaderTests-1471446188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89f6ccc0-d67c-4d16-91b1-b7a13dc0628c tempest-ProjectReaderTests-1471446188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:46 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:45:46 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7f1e1d79-ae32-41e6-8628-66c1703c647d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Acquiring lock "cinder-8b8381bf-6f06-4767-9e19-19816905aa00-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7f1e1d79-ae32-41e6-8628-66c1703c647d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "cinder-8b8381bf-6f06-4767-9e19-19816905aa00-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7f1e1d79-ae32-41e6-8628-66c1703c647d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Acquiring lock "cinder-quobyte-8b8381bf-6f06-4767-9e19-19816905aa00" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:45:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7f1e1d79-ae32-41e6-8628-66c1703c647d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "cinder-quobyte-8b8381bf-6f06-4767-9e19-19816905aa00" acquired by "delete_volume" :: waited 0.049s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:45:46 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8612808f-8cf8-4c67-95b1-6a2a40f7ea28]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:45:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7f1e1d79-ae32-41e6-8628-66c1703c647d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8b8381bf-6f06-4767-9e19-19816905aa00 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:46 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d69e0f8f-4870-48c9-a565-4f2b4be63053 tempest-TestServerVolumeAttachmentScenario-1132260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.138s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:46 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-d69e0f8f-4870-48c9-a565-4f2b4be63053 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:45:46 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d69e0f8f-4870-48c9-a565-4f2b4be63053 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Deleted volume successfully. Jul 08 14:45:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d69e0f8f-4870-48c9-a565-4f2b4be63053 tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "cinder-4df2db87-25a7-4fde-ab62-9f989c59ad48-delete_volume" released by "delete_volume" :: held 3.674s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:46 devstack sudo[102102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8b8381bf-6f06-4767-9e19-19816905aa00 Jul 08 14:45:46 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:47 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-89f6ccc0-d67c-4d16-91b1-b7a13dc0628c tempest-ProjectReaderTests-1471446188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.116s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:47 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-89f6ccc0-d67c-4d16-91b1-b7a13dc0628c tempest-ProjectReaderTests-1471446188 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:45:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-89f6ccc0-d67c-4d16-91b1-b7a13dc0628c tempest-ProjectReaderTests-1471446188 None] Deleted volume successfully. Jul 08 14:45:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-89f6ccc0-d67c-4d16-91b1-b7a13dc0628c tempest-ProjectReaderTests-1471446188 None] Lock "cinder-1185f3b2-7d54-4657-89a3-1154428b9f41-delete_volume" released by "delete_volume" :: held 3.615s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:47 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7f1e1d79-ae32-41e6-8628-66c1703c647d tempest-TestServerVolumeAttachmentScenario-1132260277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8b8381bf-6f06-4767-9e19-19816905aa00" returned: 0 in 1.258s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7f1e1d79-ae32-41e6-8628-66c1703c647d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8b8381bf-6f06-4767-9e19-19816905aa00 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:47 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8b8381bf-6f06-4767-9e19-19816905aa00 Jul 08 14:45:47 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:48 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7f1e1d79-ae32-41e6-8628-66c1703c647d tempest-TestServerVolumeAttachmentScenario-1132260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8b8381bf-6f06-4767-9e19-19816905aa00" returned: 0 in 0.917s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7f1e1d79-ae32-41e6-8628-66c1703c647d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "cinder-quobyte-8b8381bf-6f06-4767-9e19-19816905aa00" released by "delete_volume" :: held 2.250s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:48 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-7f1e1d79-ae32-41e6-8628-66c1703c647d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Created reservations ['dee3d9c2-54a4-48e5-9d93-6b01d4450942', 'd6ed2c31-f596-4dd4-83e7-1a28be3800f4', 'ea9fdb70-4ecb-428b-af93-04d3ade7d2d2', 'e27f9f14-9124-4f66-8445-2e5ccf3d40e0'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:45:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7f1e1d79-ae32-41e6-8628-66c1703c647d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7f1e1d79-ae32-41e6-8628-66c1703c647d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7f1e1d79-ae32-41e6-8628-66c1703c647d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7f1e1d79-ae32-41e6-8628-66c1703c647d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7f1e1d79-ae32-41e6-8628-66c1703c647d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7f1e1d79-ae32-41e6-8628-66c1703c647d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:48 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:45:48 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:49 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Jul 08 14:45:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7f1e1d79-ae32-41e6-8628-66c1703c647d tempest-TestServerVolumeAttachmentScenario-1132260277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.909s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:45:49 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-7f1e1d79-ae32-41e6-8628-66c1703c647d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:45:49 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7f1e1d79-ae32-41e6-8628-66c1703c647d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Deleted volume successfully. Jul 08 14:45:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-7f1e1d79-ae32-41e6-8628-66c1703c647d tempest-TestServerVolumeAttachmentScenario-1132260277 None] Lock "cinder-8b8381bf-6f06-4767-9e19-19816905aa00-delete_volume" released by "delete_volume" :: held 3.552s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:45:58 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=32,cinder:DELETE=4,cinder:SELECT=25,cinder:INSERT=8 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:45:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:45:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:45:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:45:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:45:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:45:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:45:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:45:59 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:45:59 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:45:59 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=21,cinder:INSERT=10,cinder:UPDATE=43,cinder:DELETE=2 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:46:00 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.783s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:46:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:46:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:46:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:46:17 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:46:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Flow 'volume_create_manager' (caaf2804-1701-4270-9684-8467b4dd05f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:46:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e7cb164-6715-4063-a406-415b850e1524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e7cb164-6715-4063-a406-415b850e1524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-92113132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18691cfa-04b5-406e-8adb-69a75468e8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5cb4688ff364eafb23fd9e245b862a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:46:17Z,use_quota=True,user_id='9e016b874f064e108bf907054e6857ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5142093-9b51-4d96-8395-ec65ebb47992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5142093-9b51-4d96-8395-ec65ebb47992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9a0f6d-0367-4608-be1f-729e22718cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed9a0f6d-0367-4608-be1f-729e22718cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18691cfa-04b5-406e-8adb-69a75468e8d4', 'volume_name': 'volume-18691cfa-04b5-406e-8adb-69a75468e8d4', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14e838b-ec68-4ee2-a61a-216afe5c5624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d14e838b-ec68-4ee2-a61a-216afe5c5624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aacb9384-e75e-45b1-a909-6026f8594e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:17 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Volume 18691cfa-04b5-406e-8adb-69a75468e8d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18691cfa-04b5-406e-8adb-69a75468e8d4', 'volume_size': 1} Jul 08 14:46:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-92113132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18691cfa-04b5-406e-8adb-69a75468e8d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5cb4688ff364eafb23fd9e245b862a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:46:17Z,use_quota=True,user_id='9e016b874f064e108bf907054e6857ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:46:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Creating volume 18691cfa-04b5-406e-8adb-69a75468e8d4 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:46:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:46:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:46:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:46:17 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:46:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-18691cfa-04b5-406e-8adb-69a75468e8d4 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:17 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-18691cfa-04b5-406e-8adb-69a75468e8d4 1073741824 Jul 08 14:46:17 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:18 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-18691cfa-04b5-406e-8adb-69a75468e8d4 1073741824" returned: 0 in 1.036s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-18691cfa-04b5-406e-8adb-69a75468e8d4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:18 devstack sudo[102283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-18691cfa-04b5-406e-8adb-69a75468e8d4 Jul 08 14:46:18 devstack sudo[102283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:19 devstack sudo[102283]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-18691cfa-04b5-406e-8adb-69a75468e8d4" returned: 0 in 0.847s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:46:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.956s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aacb9384-e75e-45b1-a909-6026f8594e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18691cfa-04b5-406e-8adb-69a75468e8d4', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61e22df-ba25-45b4-907b-4905f7ae4884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:19 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Volume volume-18691cfa-04b5-406e-8adb-69a75468e8d4 (18691cfa-04b5-406e-8adb-69a75468e8d4): created successfully Jul 08 14:46:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e61e22df-ba25-45b4-907b-4905f7ae4884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Flow 'volume_create_manager' (caaf2804-1701-4270-9684-8467b4dd05f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:46:19 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-78d0fdc2-8ddd-4771-bd22-f8acee79c63a tempest-TestMinimumBasicScenario-1668006563 None] Created volume successfully. Jul 08 14:46:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-98a7a622-0cb6-4d69-815e-ec3a784a2e8b req-360a31ae-7ffc-49cb-ac57-9b396e946b28 tempest-TestMinimumBasicScenario-1668006563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-98a7a622-0cb6-4d69-815e-ec3a784a2e8b req-360a31ae-7ffc-49cb-ac57-9b396e946b28 tempest-TestMinimumBasicScenario-1668006563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:24 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb248fd4-f0a0-479c-bdfd-1c79ecd4e767]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-98a7a622-0cb6-4d69-815e-ec3a784a2e8b req-360a31ae-7ffc-49cb-ac57-9b396e946b28 tempest-TestMinimumBasicScenario-1668006563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-18691cfa-04b5-406e-8adb-69a75468e8d4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:24 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-18691cfa-04b5-406e-8adb-69a75468e8d4 Jul 08 14:46:24 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:25 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-98a7a622-0cb6-4d69-815e-ec3a784a2e8b req-360a31ae-7ffc-49cb-ac57-9b396e946b28 tempest-TestMinimumBasicScenario-1668006563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-18691cfa-04b5-406e-8adb-69a75468e8d4" returned: 0 in 0.888s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-98a7a622-0cb6-4d69-815e-ec3a784a2e8b req-360a31ae-7ffc-49cb-ac57-9b396e946b28 tempest-TestMinimumBasicScenario-1668006563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.916s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-98a7a622-0cb6-4d69-815e-ec3a784a2e8b req-360a31ae-7ffc-49cb-ac57-9b396e946b28 tempest-TestMinimumBasicScenario-1668006563 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad', 'name': 'volume-18691cfa-04b5-406e-8adb-69a75468e8d4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bee61a31-a1a4-4fb4-a685-32f7b0567779', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:46:25 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-98a7a622-0cb6-4d69-815e-ec3a784a2e8b req-360a31ae-7ffc-49cb-ac57-9b396e946b28 tempest-TestMinimumBasicScenario-1668006563 None] attachment_update completed successfully. Jul 08 14:46:32 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:46:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Flow 'volume_create_manager' (b97fdda4-f092-44cf-91fe-9e8935d90651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:46:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135bd4d7-5cc4-41ef-ad69-9833b65239a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135bd4d7-5cc4-41ef-ad69-9833b65239a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-863063774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00cebdd-977e-463d-ab03-f6effa53b297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64e669f82e7248d489aa16c747769d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:46:32Z,use_quota=True,user_id='deb8cb93927c4a06b21d96bd99b9aaaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f7621b-f049-476d-85de-1e38dd5737b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60f7621b-f049-476d-85de-1e38dd5737b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca7e4f64-6abd-4356-b057-f0003fbe6467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:32 devstack cinder-volume[87240]: DEBUG cinder.image.glance [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Creating Keystone auth plugin from conf {{(pid=87240) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 14:46:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca7e4f64-6abd-4356-b057-f0003fbe6467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e00cebdd-977e-463d-ab03-f6effa53b297', 'volume_name': 'volume-e00cebdd-977e-463d-ab03-f6effa53b297', 'volume_size': 1, 'image_id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f84c09b9fe464edfa51b7a3d44e3b143', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (596fda77-a8f9-498e-bb23-3197279e197d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (596fda77-a8f9-498e-bb23-3197279e197d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417fcd24-9cc3-4615-86c7-2475b0b3fc56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:32 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Volume e00cebdd-977e-463d-ab03-f6effa53b297: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e00cebdd-977e-463d-ab03-f6effa53b297', 'volume_size': 1, 'image_id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f84c09b9fe464edfa51b7a3d44e3b143', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 14:46:32 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Trying to clone e00cebdd-977e-463d-ab03-f6effa53b297 from image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}]). {{(pid=87240) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 14:46:33 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_gdwqcxl3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 14:46:33 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Image download 20.69 MB at 20.69 MB/s Jul 08 14:46:33 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d960ee0-242f-42a9-897c-e27ba3a35b50]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_gdwqcxl3devstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:33 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_gdwqcxl3devstack@QuobyteHD Jul 08 14:46:33 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:34 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_gdwqcxl3devstack@QuobyteHD" returned: 0 in 0.919s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:34 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Temporary image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 is fetched for user deb8cb93927c4a06b21d96bd99b9aaaf. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 14:46:34 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a29715-9e7e-4ca7-a0d2-0e3439907976]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_gdwqcxl3devstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:34 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_gdwqcxl3devstack@QuobyteHD Jul 08 14:46:34 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:35 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_gdwqcxl3devstack@QuobyteHD" returned: 0 in 0.886s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:46:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-863063774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00cebdd-977e-463d-ab03-f6effa53b297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64e669f82e7248d489aa16c747769d2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:46:32Z,use_quota=True,user_id='deb8cb93927c4a06b21d96bd99b9aaaf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:46:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Creating volume e00cebdd-977e-463d-ab03-f6effa53b297 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:46:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:46:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:46:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:46:35 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:46:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:35 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 1073741824 Jul 08 14:46:35 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:36 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 1073741824" returned: 0 in 1.040s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:36 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 Jul 08 14:46:36 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:37 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297" returned: 0 in 0.732s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:46:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:37 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Attempting download of 8a72c3c4-bdc8-4198-ab53-8c7f86124915 ((None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}])) to volume e00cebdd-977e-463d-ab03-f6effa53b297. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 14:46:37 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d28469-4268-4d81-a0a1-2630f007e75a]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_pnkedvro {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:37 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_pnkedvro Jul 08 14:46:37 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:38 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_pnkedvro" returned: 0 in 0.798s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_pnkedvro {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:38 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_pnkedvro Jul 08 14:46:38 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:38 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_pnkedvro" returned: 1 in 0.840s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8a72c3c4-bdc8-4198-ab53-8c7f86124915_pnkedvro' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:46:38 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37960c5-f0a6-4957-86cf-02ec52905a5a]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_gdwqcxl3devstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:39 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_gdwqcxl3devstack@QuobyteHD Jul 08 14:46:39 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:39 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_gdwqcxl3devstack@QuobyteHD" returned: 0 in 0.821s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:39 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] 8a72c3c4-bdc8-4198-ab53-8c7f86124915 was qcow2, converting to raw {{(pid=87240) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 14:46:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_gdwqcxl3devstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:39 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_gdwqcxl3devstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 Jul 08 14:46:39 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:41 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_gdwqcxl3devstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297" returned: 0 in 2.165s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:41 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8a72c3c4-bdc8-4198-ab53-8c7f86124915_gdwqcxl3devstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:46:41 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Converted 112.00 MB image at 51.69 MB/s Jul 08 14:46:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:41 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 1G Jul 08 14:46:41 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:42 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 1G" returned: 0 in 0.745s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:42 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4a4ce7-b69f-495c-a37b-35f7ecc5f9c7]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:42 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 Jul 08 14:46:42 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:43 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297" returned: 0 in 0.767s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:43 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 Jul 08 14:46:43 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:44 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297" returned: 1 in 0.794s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:46:44 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Downloaded image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 ((None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}])) to volume e00cebdd-977e-463d-ab03-f6effa53b297 successfully. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 14:46:44 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Temporary image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 for user deb8cb93927c4a06b21d96bd99b9aaaf is deleted. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 14:46:44 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Marking volume e00cebdd-977e-463d-ab03-f6effa53b297 as bootable. {{(pid=87240) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 14:46:44 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Copying metadata from image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 to e00cebdd-977e-463d-ab03-f6effa53b297. {{(pid=87240) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 14:46:44 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Creating volume glance metadata for volume e00cebdd-977e-463d-ab03-f6effa53b297 backed by image 8a72c3c4-bdc8-4198-ab53-8c7f86124915 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87240) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 14:46:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417fcd24-9cc3-4615-86c7-2475b0b3fc56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e00cebdd-977e-463d-ab03-f6effa53b297', 'volume_size': 1, 'image_id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f84c09b9fe464edfa51b7a3d44e3b143', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8a72c3c4-bdc8-4198-ab53-8c7f86124915', 'created_at': datetime.datetime(2026, 7, 8, 12, 20, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 20, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8a72c3c4-bdc8-4198-ab53-8c7f86124915/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c41e6dc-3546-4c5f-ac7c-c69cbad546b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:46:44 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Volume volume-e00cebdd-977e-463d-ab03-f6effa53b297 (e00cebdd-977e-463d-ab03-f6effa53b297): created successfully Jul 08 14:46:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c41e6dc-3546-4c5f-ac7c-c69cbad546b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:46:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Flow 'volume_create_manager' (b97fdda4-f092-44cf-91fe-9e8935d90651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:46:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-28ce6bad-8d65-440a-9179-46ec8671b31f tempest-TestShelveInstance-1321233737 None] Created volume successfully. Jul 08 14:46:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-8bee6668-389a-44d9-abe5-259976785a74 req-6bc18da7-48f4-4c09-b4ee-9d5fa3121e5b tempest-TestShelveInstance-1321233737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-8bee6668-389a-44d9-abe5-259976785a74 req-6bc18da7-48f4-4c09-b4ee-9d5fa3121e5b tempest-TestShelveInstance-1321233737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:52 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a20d62-60ab-493d-86fd-f376d3761c5c]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:46:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-8bee6668-389a-44d9-abe5-259976785a74 req-6bc18da7-48f4-4c09-b4ee-9d5fa3121e5b tempest-TestShelveInstance-1321233737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:52 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 Jul 08 14:46:52 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:53 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-8bee6668-389a-44d9-abe5-259976785a74 req-6bc18da7-48f4-4c09-b4ee-9d5fa3121e5b tempest-TestShelveInstance-1321233737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297" returned: 0 in 0.937s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-8bee6668-389a-44d9-abe5-259976785a74 req-6bc18da7-48f4-4c09-b4ee-9d5fa3121e5b tempest-TestShelveInstance-1321233737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:53 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 Jul 08 14:46:53 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:46:54 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Jul 08 14:46:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-8bee6668-389a-44d9-abe5-259976785a74 req-6bc18da7-48f4-4c09-b4ee-9d5fa3121e5b tempest-TestShelveInstance-1321233737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297" returned: 1 in 0.953s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:46:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-8bee6668-389a-44d9-abe5-259976785a74 req-6bc18da7-48f4-4c09-b4ee-9d5fa3121e5b tempest-TestShelveInstance-1321233737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:46:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-8bee6668-389a-44d9-abe5-259976785a74 req-6bc18da7-48f4-4c09-b4ee-9d5fa3121e5b tempest-TestShelveInstance-1321233737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.967s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-8bee6668-389a-44d9-abe5-259976785a74 req-6bc18da7-48f4-4c09-b4ee-9d5fa3121e5b tempest-TestShelveInstance-1321233737 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad', 'name': 'volume-e00cebdd-977e-463d-ab03-f6effa53b297', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ab2c391-d07f-4bc2-989d-acdca3f35287', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:46:54 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-8bee6668-389a-44d9-abe5-259976785a74 req-6bc18da7-48f4-4c09-b4ee-9d5fa3121e5b tempest-TestShelveInstance-1321233737 None] attachment_update completed successfully. Jul 08 14:46:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:46:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:46:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:46:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:46:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:46:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:46:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:46:59 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:46:59 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:00 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.833s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:47:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:47:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:47:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:47:04 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=22,cinder:UPDATE=8,cinder:DELETE=2,cinder:INSERT=9 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:47:04 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=13,cinder:SELECT=23,cinder:INSERT=6 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:47:20 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-9a0046c2-aa13-401b-ad7b-bbc7af5aa524 req-261e74d6-2fec-432e-8f9f-b75ea9101772 tempest-TestMinimumBasicScenario-1668006563 None] Terminate volume connection completed successfully. Jul 08 14:47:20 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-9a0046c2-aa13-401b-ad7b-bbc7af5aa524 req-261e74d6-2fec-432e-8f9f-b75ea9101772 tempest-TestMinimumBasicScenario-1668006563 None] Deleting attachment bee61a31-a1a4-4fb4-a685-32f7b0567779. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:47:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-70f29f70-c2d1-43a1-b67d-1ad0f27d2249 tempest-TestMinimumBasicScenario-1668006563 None] Acquiring lock "cinder-18691cfa-04b5-406e-8adb-69a75468e8d4-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-70f29f70-c2d1-43a1-b67d-1ad0f27d2249 tempest-TestMinimumBasicScenario-1668006563 None] Lock "cinder-18691cfa-04b5-406e-8adb-69a75468e8d4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-70f29f70-c2d1-43a1-b67d-1ad0f27d2249 tempest-TestMinimumBasicScenario-1668006563 None] Acquiring lock "cinder-quobyte-18691cfa-04b5-406e-8adb-69a75468e8d4" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:47:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-70f29f70-c2d1-43a1-b67d-1ad0f27d2249 tempest-TestMinimumBasicScenario-1668006563 None] Lock "cinder-quobyte-18691cfa-04b5-406e-8adb-69a75468e8d4" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:47:22 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b523f86b-f4cc-4dff-81bd-2a08f2d8b85c]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-70f29f70-c2d1-43a1-b67d-1ad0f27d2249 tempest-TestMinimumBasicScenario-1668006563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-18691cfa-04b5-406e-8adb-69a75468e8d4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:22 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-18691cfa-04b5-406e-8adb-69a75468e8d4 Jul 08 14:47:22 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:23 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-70f29f70-c2d1-43a1-b67d-1ad0f27d2249 tempest-TestMinimumBasicScenario-1668006563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-18691cfa-04b5-406e-8adb-69a75468e8d4" returned: 0 in 0.839s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-70f29f70-c2d1-43a1-b67d-1ad0f27d2249 tempest-TestMinimumBasicScenario-1668006563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-18691cfa-04b5-406e-8adb-69a75468e8d4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:23 devstack sudo[103072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-18691cfa-04b5-406e-8adb-69a75468e8d4 Jul 08 14:47:23 devstack sudo[103072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:24 devstack sudo[103072]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-70f29f70-c2d1-43a1-b67d-1ad0f27d2249 tempest-TestMinimumBasicScenario-1668006563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-18691cfa-04b5-406e-8adb-69a75468e8d4" returned: 0 in 0.823s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-70f29f70-c2d1-43a1-b67d-1ad0f27d2249 tempest-TestMinimumBasicScenario-1668006563 None] Lock "cinder-quobyte-18691cfa-04b5-406e-8adb-69a75468e8d4" released by "delete_volume" :: held 1.703s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:24 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-70f29f70-c2d1-43a1-b67d-1ad0f27d2249 tempest-TestMinimumBasicScenario-1668006563 None] Created reservations ['e1568ab8-2d28-4142-a7e6-2de9bb87ea55', 'ce4aa1ff-8fe8-429f-90c9-a428a3c0e0f6', 'd5482393-2bb0-478d-aa51-5803d38d5a2f', 'dc0442da-b61e-4834-b86e-7ec532ca47dd'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:47:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-70f29f70-c2d1-43a1-b67d-1ad0f27d2249 tempest-TestMinimumBasicScenario-1668006563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-70f29f70-c2d1-43a1-b67d-1ad0f27d2249 tempest-TestMinimumBasicScenario-1668006563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-70f29f70-c2d1-43a1-b67d-1ad0f27d2249 tempest-TestMinimumBasicScenario-1668006563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:47:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-70f29f70-c2d1-43a1-b67d-1ad0f27d2249 tempest-TestMinimumBasicScenario-1668006563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:47:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-70f29f70-c2d1-43a1-b67d-1ad0f27d2249 tempest-TestMinimumBasicScenario-1668006563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-70f29f70-c2d1-43a1-b67d-1ad0f27d2249 tempest-TestMinimumBasicScenario-1668006563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:24 devstack sudo[103075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:47:24 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:25 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-70f29f70-c2d1-43a1-b67d-1ad0f27d2249 tempest-TestMinimumBasicScenario-1668006563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.721s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:25 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-70f29f70-c2d1-43a1-b67d-1ad0f27d2249 tempest-TestMinimumBasicScenario-1668006563 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:47:25 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-70f29f70-c2d1-43a1-b67d-1ad0f27d2249 tempest-TestMinimumBasicScenario-1668006563 None] Deleted volume successfully. Jul 08 14:47:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-70f29f70-c2d1-43a1-b67d-1ad0f27d2249 tempest-TestMinimumBasicScenario-1668006563 None] Lock "cinder-18691cfa-04b5-406e-8adb-69a75468e8d4-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:47:32 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-30e45f67-48ac-4b17-9160-cd365dde042a req-2dc39178-9b4c-4591-bfce-0ac65ef03234 tempest-TestShelveInstance-1321233737 None] Terminate volume connection completed successfully. Jul 08 14:47:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-30e45f67-48ac-4b17-9160-cd365dde042a req-2dc39178-9b4c-4591-bfce-0ac65ef03234 tempest-TestShelveInstance-1321233737 None] Deleting attachment 3ab2c391-d07f-4bc2-989d-acdca3f35287. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:47:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-7ab5f439-7314-4cc1-b8de-087f31a04196 req-02bf9b26-6c4f-4667-b0a4-d8a77fb0b9b3 tempest-TestShelveInstance-1321233737 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-7ab5f439-7314-4cc1-b8de-087f31a04196 req-02bf9b26-6c4f-4667-b0a4-d8a77fb0b9b3 tempest-TestShelveInstance-1321233737 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:38 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1acf5af-f5c8-41ca-a00b-b3e7e6c73655]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:47:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-7ab5f439-7314-4cc1-b8de-087f31a04196 req-02bf9b26-6c4f-4667-b0a4-d8a77fb0b9b3 tempest-TestShelveInstance-1321233737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:38 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 Jul 08 14:47:38 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:39 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-7ab5f439-7314-4cc1-b8de-087f31a04196 req-02bf9b26-6c4f-4667-b0a4-d8a77fb0b9b3 tempest-TestShelveInstance-1321233737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297" returned: 0 in 0.854s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-7ab5f439-7314-4cc1-b8de-087f31a04196 req-02bf9b26-6c4f-4667-b0a4-d8a77fb0b9b3 tempest-TestShelveInstance-1321233737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:39 devstack sudo[103149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 Jul 08 14:47:39 devstack sudo[103149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:47:40 devstack sudo[103149]: pam_unix(sudo:session): session closed for user root Jul 08 14:47:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-7ab5f439-7314-4cc1-b8de-087f31a04196 req-02bf9b26-6c4f-4667-b0a4-d8a77fb0b9b3 tempest-TestShelveInstance-1321233737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297" returned: 1 in 0.985s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:47:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-7ab5f439-7314-4cc1-b8de-087f31a04196 req-02bf9b26-6c4f-4667-b0a4-d8a77fb0b9b3 tempest-TestShelveInstance-1321233737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:47:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-7ab5f439-7314-4cc1-b8de-087f31a04196 req-02bf9b26-6c4f-4667-b0a4-d8a77fb0b9b3 tempest-TestShelveInstance-1321233737 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.883s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:40 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-7ab5f439-7314-4cc1-b8de-087f31a04196 req-02bf9b26-6c4f-4667-b0a4-d8a77fb0b9b3 tempest-TestShelveInstance-1321233737 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad', 'name': 'volume-e00cebdd-977e-463d-ab03-f6effa53b297', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2321bd68-583a-4765-855b-5303170d53d4', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:47:40 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-7ab5f439-7314-4cc1-b8de-087f31a04196 req-02bf9b26-6c4f-4667-b0a4-d8a77fb0b9b3 tempest-TestShelveInstance-1321233737 None] attachment_update completed successfully. Jul 08 14:47:55 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=16,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:47:55 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=10,cinder:INSERT=2,cinder:UPDATE=11 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:47:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:47:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:47:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:47:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:47:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:47:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:47:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:47:59 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:47:59 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:00 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.678s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:48:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:48:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:48:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:48:35 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-ecf6d424-679d-4a65-8fb3-1bae413da2fb tempest-TestShelveInstance-1321233737 None] Terminate volume connection completed successfully. Jul 08 14:48:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-ecf6d424-679d-4a65-8fb3-1bae413da2fb tempest-TestShelveInstance-1321233737 None] Deleting attachment 2321bd68-583a-4765-855b-5303170d53d4. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:48:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-de01df57-162a-4268-8d31-10616de7ea01 tempest-TestShelveInstance-1321233737 None] Acquiring lock "cinder-e00cebdd-977e-463d-ab03-f6effa53b297-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-de01df57-162a-4268-8d31-10616de7ea01 tempest-TestShelveInstance-1321233737 None] Lock "cinder-e00cebdd-977e-463d-ab03-f6effa53b297-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-de01df57-162a-4268-8d31-10616de7ea01 tempest-TestShelveInstance-1321233737 None] Acquiring lock "cinder-quobyte-e00cebdd-977e-463d-ab03-f6effa53b297" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:48:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-de01df57-162a-4268-8d31-10616de7ea01 tempest-TestShelveInstance-1321233737 None] Lock "cinder-quobyte-e00cebdd-977e-463d-ab03-f6effa53b297" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:48:36 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94c4cdb-bdf9-478d-a65d-718f1bba283f]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-de01df57-162a-4268-8d31-10616de7ea01 tempest-TestShelveInstance-1321233737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:36 devstack sudo[103829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 Jul 08 14:48:36 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:37 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-de01df57-162a-4268-8d31-10616de7ea01 tempest-TestShelveInstance-1321233737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297" returned: 0 in 0.833s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-de01df57-162a-4268-8d31-10616de7ea01 tempest-TestShelveInstance-1321233737 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:37 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 Jul 08 14:48:37 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:38 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-de01df57-162a-4268-8d31-10616de7ea01 tempest-TestShelveInstance-1321233737 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297" returned: 1 in 0.790s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-de01df57-162a-4268-8d31-10616de7ea01 tempest-TestShelveInstance-1321233737 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:48:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-de01df57-162a-4268-8d31-10616de7ea01 tempest-TestShelveInstance-1321233737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:38 devstack sudo[103838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297 Jul 08 14:48:38 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:39 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-de01df57-162a-4268-8d31-10616de7ea01 tempest-TestShelveInstance-1321233737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e00cebdd-977e-463d-ab03-f6effa53b297" returned: 0 in 0.736s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-de01df57-162a-4268-8d31-10616de7ea01 tempest-TestShelveInstance-1321233737 None] Lock "cinder-quobyte-e00cebdd-977e-463d-ab03-f6effa53b297" released by "delete_volume" :: held 2.446s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:39 devstack cinder-volume[87240]: DEBUG cinder.quota [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-de01df57-162a-4268-8d31-10616de7ea01 tempest-TestShelveInstance-1321233737 None] Created reservations ['1f0a0e23-a9be-44c4-bfd5-8304862bfb25', '29142f3a-f463-41f4-874e-5224d0627c3f', 'adc136d6-ee2a-4c52-9b13-bdb01d851968', '2da3e3d6-1cd0-4d67-a54c-739806b53f34'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:48:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-de01df57-162a-4268-8d31-10616de7ea01 tempest-TestShelveInstance-1321233737 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-de01df57-162a-4268-8d31-10616de7ea01 tempest-TestShelveInstance-1321233737 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-de01df57-162a-4268-8d31-10616de7ea01 tempest-TestShelveInstance-1321233737 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-de01df57-162a-4268-8d31-10616de7ea01 tempest-TestShelveInstance-1321233737 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-de01df57-162a-4268-8d31-10616de7ea01 tempest-TestShelveInstance-1321233737 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-de01df57-162a-4268-8d31-10616de7ea01 tempest-TestShelveInstance-1321233737 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:39 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:48:39 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:39 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-de01df57-162a-4268-8d31-10616de7ea01 tempest-TestShelveInstance-1321233737 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.757s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:39 devstack cinder-volume[87240]: DEBUG cinder.manager [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-de01df57-162a-4268-8d31-10616de7ea01 tempest-TestShelveInstance-1321233737 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:48:39 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-de01df57-162a-4268-8d31-10616de7ea01 tempest-TestShelveInstance-1321233737 None] Deleted volume successfully. Jul 08 14:48:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [req-8871d86e-81bd-465b-9fc4-b7d3bb57fd67 req-de01df57-162a-4268-8d31-10616de7ea01 tempest-TestShelveInstance-1321233737 None] Lock "cinder-e00cebdd-977e-463d-ab03-f6effa53b297-delete_volume" released by "delete_volume" :: held 3.429s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:48:46 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:48:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Flow 'volume_create_manager' (8d6be057-b99e-4a92-8ef6-9249b4897668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b904b3c-7964-4325-a0a1-d860819d9efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b904b3c-7964-4325-a0a1-d860819d9efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1717865158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded548dc-70c2-454b-a235-65f79b0082fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02785115bb0a45e7b9f9080ea99801ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:47Z,use_quota=True,user_id='87c600e07fc74211a726c3e70ef9b6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504b506b-025c-4bf5-9494-cbb15e048934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504b506b-025c-4bf5-9494-cbb15e048934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20ad6268-5300-4031-9f30-2f2205df1701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20ad6268-5300-4031-9f30-2f2205df1701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ded548dc-70c2-454b-a235-65f79b0082fa', 'volume_name': 'volume-ded548dc-70c2-454b-a235-65f79b0082fa', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd0458e-06b1-4bfd-8169-411aa6b366f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd0458e-06b1-4bfd-8169-411aa6b366f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b78d4a78-c695-40a5-822c-73f1b8860dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:46 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Volume ded548dc-70c2-454b-a235-65f79b0082fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ded548dc-70c2-454b-a235-65f79b0082fa', 'volume_size': 1} Jul 08 14:48:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1717865158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded548dc-70c2-454b-a235-65f79b0082fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02785115bb0a45e7b9f9080ea99801ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:47Z,use_quota=True,user_id='87c600e07fc74211a726c3e70ef9b6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:48:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Creating volume ded548dc-70c2-454b-a235-65f79b0082fa {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:48:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:48:46 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:48:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ded548dc-70c2-454b-a235-65f79b0082fa 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:46 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ded548dc-70c2-454b-a235-65f79b0082fa 1073741824 Jul 08 14:48:46 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:47 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ded548dc-70c2-454b-a235-65f79b0082fa 1073741824" returned: 0 in 0.944s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ded548dc-70c2-454b-a235-65f79b0082fa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:47 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ded548dc-70c2-454b-a235-65f79b0082fa Jul 08 14:48:47 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:48 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ded548dc-70c2-454b-a235-65f79b0082fa" returned: 0 in 0.679s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:48:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b78d4a78-c695-40a5-822c-73f1b8860dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ded548dc-70c2-454b-a235-65f79b0082fa', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (332dd161-0f51-4c19-86ba-34f17c9dd12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:48 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Volume volume-ded548dc-70c2-454b-a235-65f79b0082fa (ded548dc-70c2-454b-a235-65f79b0082fa): created successfully Jul 08 14:48:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (332dd161-0f51-4c19-86ba-34f17c9dd12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Flow 'volume_create_manager' (8d6be057-b99e-4a92-8ef6-9249b4897668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:48 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a8395883-7263-4506-8e84-d2ccdf99beae tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Created volume successfully. Jul 08 14:48:50 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:48:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Flow 'volume_create_manager' (48f877b3-3489-4e78-8848-df2b8ea2160e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec8910b0-84c7-48bc-ab7e-0f160d7fb153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec8910b0-84c7-48bc-ab7e-0f160d7fb153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-489484362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a722fe75-558f-418f-8d01-38cf41d67237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1e5b203b7eb4a1bb42bbb931e743f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:51Z,use_quota=True,user_id='45b3d36c790c4556b2d2305915c06e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b1aaae9-a3ed-43e9-8a72-dfb729891f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b1aaae9-a3ed-43e9-8a72-dfb729891f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3251cde1-029a-4a63-87c0-84ae53ea4f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3251cde1-029a-4a63-87c0-84ae53ea4f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a722fe75-558f-418f-8d01-38cf41d67237', 'volume_name': 'volume-a722fe75-558f-418f-8d01-38cf41d67237', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27618adc-f8ca-4901-ae03-f89fcda4bbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27618adc-f8ca-4901-ae03-f89fcda4bbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42df4062-604b-43dc-a6af-29ae136dc118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:50 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Volume a722fe75-558f-418f-8d01-38cf41d67237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a722fe75-558f-418f-8d01-38cf41d67237', 'volume_size': 1} Jul 08 14:48:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-489484362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a722fe75-558f-418f-8d01-38cf41d67237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1e5b203b7eb4a1bb42bbb931e743f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:51Z,use_quota=True,user_id='45b3d36c790c4556b2d2305915c06e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:48:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Creating volume a722fe75-558f-418f-8d01-38cf41d67237 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:48:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:48:50 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:48:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a722fe75-558f-418f-8d01-38cf41d67237 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:50 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a722fe75-558f-418f-8d01-38cf41d67237 1073741824 Jul 08 14:48:50 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Flow 'volume_create_manager' (31c19b87-b5c8-4677-a01b-6cefe2b83823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c375f2b-f43a-4f58-b91e-ca4a5f8dbd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c375f2b-f43a-4f58-b91e-ca4a5f8dbd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-407344289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1e5b203b7eb4a1bb42bbb931e743f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:51Z,use_quota=True,user_id='45b3d36c790c4556b2d2305915c06e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f042f08f-dc37-40e7-8e23-7400368bb6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f042f08f-dc37-40e7-8e23-7400368bb6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e90831-c779-419c-8d2f-596dfa70be65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e90831-c779-419c-8d2f-596dfa70be65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5', 'volume_name': 'volume-422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da6f7c63-b506-43d0-b36f-dc943ba9558f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da6f7c63-b506-43d0-b36f-dc943ba9558f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47cf5fc-16fd-4bed-8c58-395b07ff190b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:51 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Volume 422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5', 'volume_size': 1} Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Flow 'volume_create_manager' (7e3d1e41-bf37-4f0e-a22e-17aed13de78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8659c8a-e1c3-4147-8788-ea80434fad31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8659c8a-e1c3-4147-8788-ea80434fad31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1880667666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3729ac2a-74cf-448f-9022-0cdba8e6aa59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1e5b203b7eb4a1bb42bbb931e743f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:52Z,use_quota=True,user_id='45b3d36c790c4556b2d2305915c06e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d07d1ff-880d-44b6-8553-826a4d36eedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d07d1ff-880d-44b6-8553-826a4d36eedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35e6aee7-3a2e-4fc3-afbb-e8be6ccd1b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35e6aee7-3a2e-4fc3-afbb-e8be6ccd1b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3729ac2a-74cf-448f-9022-0cdba8e6aa59', 'volume_name': 'volume-3729ac2a-74cf-448f-9022-0cdba8e6aa59', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47409a74-0bf8-479a-b9a6-e602d23dc35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47409a74-0bf8-479a-b9a6-e602d23dc35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a0571d-83a7-48ea-bdc0-d873a370eb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:51 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Volume 3729ac2a-74cf-448f-9022-0cdba8e6aa59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3729ac2a-74cf-448f-9022-0cdba8e6aa59', 'volume_size': 1} Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:51 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a722fe75-558f-418f-8d01-38cf41d67237 1073741824" returned: 0 in 1.087s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a722fe75-558f-418f-8d01-38cf41d67237 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:52 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a722fe75-558f-418f-8d01-38cf41d67237 Jul 08 14:48:52 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Flow 'volume_create_manager' (4cf512cd-2e17-4754-89da-9f9bc3b08b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c2e7832-879a-4f50-adcc-52adc750344d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c2e7832-879a-4f50-adcc-52adc750344d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1008732105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1b88c7-4522-41c4-9e12-ec124dda4d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1e5b203b7eb4a1bb42bbb931e743f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:52Z,use_quota=True,user_id='45b3d36c790c4556b2d2305915c06e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (389047c8-0f21-49df-b820-30ab7584551b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (389047c8-0f21-49df-b820-30ab7584551b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2945d4-1c9d-4b50-a55b-acbce275feff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd2945d4-1c9d-4b50-a55b-acbce275feff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b1b88c7-4522-41c4-9e12-ec124dda4d06', 'volume_name': 'volume-0b1b88c7-4522-41c4-9e12-ec124dda4d06', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36dc7b5-51c8-4e21-a784-d576e9903015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36dc7b5-51c8-4e21-a784-d576e9903015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49757e6c-237e-4715-b493-3461d696b194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:52 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Volume 0b1b88c7-4522-41c4-9e12-ec124dda4d06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b1b88c7-4522-41c4-9e12-ec124dda4d06', 'volume_size': 1} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-eee49895-e4d8-47fe-b2e7-bfc22a6c4a06 req-3f2bb2fa-fd3a-45dc-94ce-2266ab7d7863 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Flow 'volume_create_manager' (81b831a1-df31-4b92-94bd-4d5a099505f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5d2207-b669-4c58-837f-032aea31e9e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5d2207-b669-4c58-837f-032aea31e9e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1245091154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a901355-72bb-4c96-91b0-904558f00119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1e5b203b7eb4a1bb42bbb931e743f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:52Z,use_quota=True,user_id='45b3d36c790c4556b2d2305915c06e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17dcc5c-3bc1-46e0-8254-2364479b1b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b17dcc5c-3bc1-46e0-8254-2364479b1b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b3cd33-3e88-466d-bf55-20afc2c0d5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b3cd33-3e88-466d-bf55-20afc2c0d5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a901355-72bb-4c96-91b0-904558f00119', 'volume_name': 'volume-8a901355-72bb-4c96-91b0-904558f00119', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea238b8-fb2e-4f93-9439-5c5049868146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea238b8-fb2e-4f93-9439-5c5049868146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (981fa662-5a00-429b-b064-a1a04f9f0843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:52 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Volume 8a901355-72bb-4c96-91b0-904558f00119: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a901355-72bb-4c96-91b0-904558f00119', 'volume_size': 1} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:52 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a722fe75-558f-418f-8d01-38cf41d67237" returned: 0 in 0.795s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.506s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-407344289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1e5b203b7eb4a1bb42bbb931e743f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:51Z,use_quota=True,user_id='45b3d36c790c4556b2d2305915c06e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Creating volume 422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:48:52 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:52 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5 1073741824 Jul 08 14:48:52 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42df4062-604b-43dc-a6af-29ae136dc118) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a722fe75-558f-418f-8d01-38cf41d67237', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1823854f-6fc7-41ec-af51-5a50d318071b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:52 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Volume volume-a722fe75-558f-418f-8d01-38cf41d67237 (a722fe75-558f-418f-8d01-38cf41d67237): created successfully Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1823854f-6fc7-41ec-af51-5a50d318071b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Flow 'volume_create_manager' (48f877b3-3489-4e78-8848-df2b8ea2160e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:52 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6f131093-8d29-4697-aae7-b82fa73d6404 tempest-CreateVolumesFromImageTest-1397772901 None] Created volume successfully. Jul 08 14:48:53 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5 1073741824" returned: 0 in 0.826s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:53 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5 Jul 08 14:48:53 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:54 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5" returned: 0 in 0.709s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:48:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.626s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1880667666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3729ac2a-74cf-448f-9022-0cdba8e6aa59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1e5b203b7eb4a1bb42bbb931e743f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:52Z,use_quota=True,user_id='45b3d36c790c4556b2d2305915c06e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:48:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Creating volume 3729ac2a-74cf-448f-9022-0cdba8e6aa59 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:48:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:48:54 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:48:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3729ac2a-74cf-448f-9022-0cdba8e6aa59 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a47cf5fc-16fd-4bed-8c58-395b07ff190b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:54 devstack sudo[103935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3729ac2a-74cf-448f-9022-0cdba8e6aa59 1073741824 Jul 08 14:48:54 devstack sudo[103935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f3392c-f361-4c07-8d3c-ff840b4c0fb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:54 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Volume volume-422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5 (422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5): created successfully Jul 08 14:48:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f3392c-f361-4c07-8d3c-ff840b4c0fb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Flow 'volume_create_manager' (31c19b87-b5c8-4677-a01b-6cefe2b83823) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:54 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-264edca0-d5c5-4c84-afd6-70498bd716a9 tempest-CreateVolumesFromImageTest-1397772901 None] Created volume successfully. Jul 08 14:48:55 devstack sudo[103935]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3729ac2a-74cf-448f-9022-0cdba8e6aa59 1073741824" returned: 0 in 0.856s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3729ac2a-74cf-448f-9022-0cdba8e6aa59 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:55 devstack sudo[103940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3729ac2a-74cf-448f-9022-0cdba8e6aa59 Jul 08 14:48:55 devstack sudo[103940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:55 devstack sudo[103940]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3729ac2a-74cf-448f-9022-0cdba8e6aa59" returned: 0 in 0.646s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:48:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.688s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1008732105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1b88c7-4522-41c4-9e12-ec124dda4d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1e5b203b7eb4a1bb42bbb931e743f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:52Z,use_quota=True,user_id='45b3d36c790c4556b2d2305915c06e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:48:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Creating volume 0b1b88c7-4522-41c4-9e12-ec124dda4d06 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:48:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:48:55 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:48:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0b1b88c7-4522-41c4-9e12-ec124dda4d06 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:56 devstack sudo[103943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0b1b88c7-4522-41c4-9e12-ec124dda4d06 1073741824 Jul 08 14:48:56 devstack sudo[103943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a0571d-83a7-48ea-bdc0-d873a370eb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3729ac2a-74cf-448f-9022-0cdba8e6aa59', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe419509-1e3e-4be4-8f5d-ee7667079bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:56 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Volume volume-3729ac2a-74cf-448f-9022-0cdba8e6aa59 (3729ac2a-74cf-448f-9022-0cdba8e6aa59): created successfully Jul 08 14:48:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe419509-1e3e-4be4-8f5d-ee7667079bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Flow 'volume_create_manager' (7e3d1e41-bf37-4f0e-a22e-17aed13de78f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:56 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-78665e80-605b-4741-96b7-59f35b4aaaaf tempest-CreateVolumesFromImageTest-1397772901 None] Created volume successfully. Jul 08 14:48:56 devstack sudo[103943]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0b1b88c7-4522-41c4-9e12-ec124dda4d06 1073741824" returned: 0 in 0.811s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0b1b88c7-4522-41c4-9e12-ec124dda4d06 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:56 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0b1b88c7-4522-41c4-9e12-ec124dda4d06 Jul 08 14:48:56 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:57 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0b1b88c7-4522-41c4-9e12-ec124dda4d06" returned: 0 in 0.646s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:48:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-eee49895-e4d8-47fe-b2e7-bfc22a6c4a06 req-3f2bb2fa-fd3a-45dc-94ce-2266ab7d7863 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.027s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49757e6c-237e-4715-b493-3461d696b194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b1b88c7-4522-41c4-9e12-ec124dda4d06', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb54290-643b-4bfb-943d-64c2ee97f338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:57 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5e1c48-edf5-4c52-81f4-41d88a874414]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:48:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-eee49895-e4d8-47fe-b2e7-bfc22a6c4a06 req-3f2bb2fa-fd3a-45dc-94ce-2266ab7d7863 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ded548dc-70c2-454b-a235-65f79b0082fa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:57 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Volume volume-0b1b88c7-4522-41c4-9e12-ec124dda4d06 (0b1b88c7-4522-41c4-9e12-ec124dda4d06): created successfully Jul 08 14:48:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfb54290-643b-4bfb-943d-64c2ee97f338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Flow 'volume_create_manager' (4cf512cd-2e17-4754-89da-9f9bc3b08b4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:57 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a51632ad-2cdf-428d-9f6b-8569fe09717b tempest-CreateVolumesFromImageTest-1397772901 None] Created volume successfully. Jul 08 14:48:57 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ded548dc-70c2-454b-a235-65f79b0082fa Jul 08 14:48:57 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:58 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-eee49895-e4d8-47fe-b2e7-bfc22a6c4a06 req-3f2bb2fa-fd3a-45dc-94ce-2266ab7d7863 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ded548dc-70c2-454b-a235-65f79b0082fa" returned: 0 in 0.751s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-eee49895-e4d8-47fe-b2e7-bfc22a6c4a06 req-3f2bb2fa-fd3a-45dc-94ce-2266ab7d7863 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.777s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.645s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:48:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1245091154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a901355-72bb-4c96-91b0-904558f00119,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1e5b203b7eb4a1bb42bbb931e743f40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:48:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:48:52Z,use_quota=True,user_id='45b3d36c790c4556b2d2305915c06e3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:48:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Creating volume 8a901355-72bb-4c96-91b0-904558f00119 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:48:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:48:58 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:48:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8a901355-72bb-4c96-91b0-904558f00119 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:58 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8a901355-72bb-4c96-91b0-904558f00119 1073741824 Jul 08 14:48:58 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-eee49895-e4d8-47fe-b2e7-bfc22a6c4a06 req-3f2bb2fa-fd3a-45dc-94ce-2266ab7d7863 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad', 'name': 'volume-ded548dc-70c2-454b-a235-65f79b0082fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '509c36d3-9ec6-4bc7-b89d-1093073c5046', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:48:58 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-eee49895-e4d8-47fe-b2e7-bfc22a6c4a06 req-3f2bb2fa-fd3a-45dc-94ce-2266ab7d7863 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] attachment_update completed successfully. Jul 08 14:48:59 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8a901355-72bb-4c96-91b0-904558f00119 1073741824" returned: 0 in 0.887s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8a901355-72bb-4c96-91b0-904558f00119 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:59 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8a901355-72bb-4c96-91b0-904558f00119 Jul 08 14:48:59 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:48:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:48:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:48:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:48:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:48:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:48:59 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:48:59 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:48:59 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Jul 08 14:48:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8a901355-72bb-4c96-91b0-904558f00119" returned: 0 in 0.637s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:48:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:48:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:48:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (981fa662-5a00-429b-b064-a1a04f9f0843) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a901355-72bb-4c96-91b0-904558f00119', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce49776-58aa-4296-9e73-bfaa70549940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:48:59 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Volume volume-8a901355-72bb-4c96-91b0-904558f00119 (8a901355-72bb-4c96-91b0-904558f00119): created successfully Jul 08 14:48:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ce49776-58aa-4296-9e73-bfaa70549940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:48:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Flow 'volume_create_manager' (81b831a1-df31-4b92-94bd-4d5a099505f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:48:59 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0833e46d-db8b-4ad5-b178-d9a681292123 tempest-CreateVolumesFromImageTest-1397772901 None] Created volume successfully. Jul 08 14:49:00 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.664s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:49:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:49:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:49:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:49:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-09c6c01c-bcec-44f9-9cf3-1a9633f0d342 tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "cinder-8a901355-72bb-4c96-91b0-904558f00119-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-09c6c01c-bcec-44f9-9cf3-1a9633f0d342 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "cinder-8a901355-72bb-4c96-91b0-904558f00119-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-09c6c01c-bcec-44f9-9cf3-1a9633f0d342 tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "cinder-quobyte-8a901355-72bb-4c96-91b0-904558f00119" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-09c6c01c-bcec-44f9-9cf3-1a9633f0d342 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "cinder-quobyte-8a901355-72bb-4c96-91b0-904558f00119" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:00 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[518d823d-54c3-4846-bc55-da157b4f3f84]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:49:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-09c6c01c-bcec-44f9-9cf3-1a9633f0d342 tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8a901355-72bb-4c96-91b0-904558f00119 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:00 devstack sudo[104352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8a901355-72bb-4c96-91b0-904558f00119 Jul 08 14:49:00 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:01 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-09c6c01c-bcec-44f9-9cf3-1a9633f0d342 tempest-CreateVolumesFromImageTest-1397772901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8a901355-72bb-4c96-91b0-904558f00119" returned: 0 in 0.843s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-09c6c01c-bcec-44f9-9cf3-1a9633f0d342 tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8a901355-72bb-4c96-91b0-904558f00119 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:01 devstack sudo[104357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8a901355-72bb-4c96-91b0-904558f00119 Jul 08 14:49:01 devstack sudo[104357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:01 devstack sudo[104357]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-09c6c01c-bcec-44f9-9cf3-1a9633f0d342 tempest-CreateVolumesFromImageTest-1397772901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-8a901355-72bb-4c96-91b0-904558f00119" returned: 0 in 0.642s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-09c6c01c-bcec-44f9-9cf3-1a9633f0d342 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "cinder-quobyte-8a901355-72bb-4c96-91b0-904558f00119" released by "delete_volume" :: held 1.524s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:01 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-09c6c01c-bcec-44f9-9cf3-1a9633f0d342 tempest-CreateVolumesFromImageTest-1397772901 None] Created reservations ['8f417e7f-0e41-455a-87f5-17b42a6f0006', 'a5cfedf4-a7e2-4aae-a18c-d4b339eb5056', '67885a25-a6c6-467d-aed6-cf0bc6c45463', '02405885-89a4-4c2b-af39-cade0dcb36ba'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:49:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-09c6c01c-bcec-44f9-9cf3-1a9633f0d342 tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:49:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-09c6c01c-bcec-44f9-9cf3-1a9633f0d342 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:49:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-09c6c01c-bcec-44f9-9cf3-1a9633f0d342 tempest-CreateVolumesFromImageTest-1397772901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:49:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-09c6c01c-bcec-44f9-9cf3-1a9633f0d342 tempest-CreateVolumesFromImageTest-1397772901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:49:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-09c6c01c-bcec-44f9-9cf3-1a9633f0d342 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:49:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-09c6c01c-bcec-44f9-9cf3-1a9633f0d342 tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:01 devstack sudo[104362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:49:01 devstack sudo[104362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3b2125ea-fb3d-4702-90d7-7567f73054c8 tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "cinder-0b1b88c7-4522-41c4-9e12-ec124dda4d06-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3b2125ea-fb3d-4702-90d7-7567f73054c8 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "cinder-0b1b88c7-4522-41c4-9e12-ec124dda4d06-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3b2125ea-fb3d-4702-90d7-7567f73054c8 tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "cinder-quobyte-0b1b88c7-4522-41c4-9e12-ec124dda4d06" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3b2125ea-fb3d-4702-90d7-7567f73054c8 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "cinder-quobyte-0b1b88c7-4522-41c4-9e12-ec124dda4d06" acquired by "delete_volume" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:02 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5bd314-17e4-487e-a577-dcbe397627d1]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:49:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3b2125ea-fb3d-4702-90d7-7567f73054c8 tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0b1b88c7-4522-41c4-9e12-ec124dda4d06 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:02 devstack sudo[104362]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-09c6c01c-bcec-44f9-9cf3-1a9633f0d342 tempest-CreateVolumesFromImageTest-1397772901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.748s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:02 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-09c6c01c-bcec-44f9-9cf3-1a9633f0d342 tempest-CreateVolumesFromImageTest-1397772901 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:49:02 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-09c6c01c-bcec-44f9-9cf3-1a9633f0d342 tempest-CreateVolumesFromImageTest-1397772901 None] Deleted volume successfully. Jul 08 14:49:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-09c6c01c-bcec-44f9-9cf3-1a9633f0d342 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "cinder-8a901355-72bb-4c96-91b0-904558f00119-delete_volume" released by "delete_volume" :: held 2.503s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:02 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0b1b88c7-4522-41c4-9e12-ec124dda4d06 Jul 08 14:49:02 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:03 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3b2125ea-fb3d-4702-90d7-7567f73054c8 tempest-CreateVolumesFromImageTest-1397772901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0b1b88c7-4522-41c4-9e12-ec124dda4d06" returned: 0 in 0.798s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3b2125ea-fb3d-4702-90d7-7567f73054c8 tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0b1b88c7-4522-41c4-9e12-ec124dda4d06 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:03 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0b1b88c7-4522-41c4-9e12-ec124dda4d06 Jul 08 14:49:03 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:04 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-c44980cd-9c05-49e5-a3b1-95d9ac9b9642 req-24616cfa-56ab-443d-ad2a-1185417788c8 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Terminate volume connection completed successfully. Jul 08 14:49:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-c44980cd-9c05-49e5-a3b1-95d9ac9b9642 req-24616cfa-56ab-443d-ad2a-1185417788c8 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Deleting attachment 509c36d3-9ec6-4bc7-b89d-1093073c5046. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:49:04 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3b2125ea-fb3d-4702-90d7-7567f73054c8 tempest-CreateVolumesFromImageTest-1397772901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0b1b88c7-4522-41c4-9e12-ec124dda4d06" returned: 0 in 0.741s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3b2125ea-fb3d-4702-90d7-7567f73054c8 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "cinder-quobyte-0b1b88c7-4522-41c4-9e12-ec124dda4d06" released by "delete_volume" :: held 1.619s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:04 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-3b2125ea-fb3d-4702-90d7-7567f73054c8 tempest-CreateVolumesFromImageTest-1397772901 None] Created reservations ['0a6849ee-76ef-4fef-b3c1-3e4a389f8c56', '38b2d455-29d9-4da8-9354-e280ea9e87b7', 'ff55b79b-e3c3-4d20-a004-669267dcf2ee', 'f5f08486-7b0f-4cf6-9508-cb478b8393b0'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:49:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3b2125ea-fb3d-4702-90d7-7567f73054c8 tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:49:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3b2125ea-fb3d-4702-90d7-7567f73054c8 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:49:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3b2125ea-fb3d-4702-90d7-7567f73054c8 tempest-CreateVolumesFromImageTest-1397772901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:49:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3b2125ea-fb3d-4702-90d7-7567f73054c8 tempest-CreateVolumesFromImageTest-1397772901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:49:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3b2125ea-fb3d-4702-90d7-7567f73054c8 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:49:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3b2125ea-fb3d-4702-90d7-7567f73054c8 tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:04 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:49:04 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a20dbcbd-8ebc-49fe-a5f2-e18056bc0276 tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "cinder-3729ac2a-74cf-448f-9022-0cdba8e6aa59-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a20dbcbd-8ebc-49fe-a5f2-e18056bc0276 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "cinder-3729ac2a-74cf-448f-9022-0cdba8e6aa59-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a20dbcbd-8ebc-49fe-a5f2-e18056bc0276 tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "cinder-quobyte-3729ac2a-74cf-448f-9022-0cdba8e6aa59" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a20dbcbd-8ebc-49fe-a5f2-e18056bc0276 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "cinder-quobyte-3729ac2a-74cf-448f-9022-0cdba8e6aa59" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:04 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[87677bd9-285b-433a-ad50-1c31ac098659]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:49:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a20dbcbd-8ebc-49fe-a5f2-e18056bc0276 tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3729ac2a-74cf-448f-9022-0cdba8e6aa59 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:05 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3729ac2a-74cf-448f-9022-0cdba8e6aa59 Jul 08 14:49:05 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:05 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3b2125ea-fb3d-4702-90d7-7567f73054c8 tempest-CreateVolumesFromImageTest-1397772901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.727s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:05 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-3b2125ea-fb3d-4702-90d7-7567f73054c8 tempest-CreateVolumesFromImageTest-1397772901 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:49:05 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3b2125ea-fb3d-4702-90d7-7567f73054c8 tempest-CreateVolumesFromImageTest-1397772901 None] Deleted volume successfully. Jul 08 14:49:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3b2125ea-fb3d-4702-90d7-7567f73054c8 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "cinder-0b1b88c7-4522-41c4-9e12-ec124dda4d06-delete_volume" released by "delete_volume" :: held 2.578s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:05 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a20dbcbd-8ebc-49fe-a5f2-e18056bc0276 tempest-CreateVolumesFromImageTest-1397772901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3729ac2a-74cf-448f-9022-0cdba8e6aa59" returned: 0 in 0.810s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a20dbcbd-8ebc-49fe-a5f2-e18056bc0276 tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3729ac2a-74cf-448f-9022-0cdba8e6aa59 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:05 devstack sudo[104417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3729ac2a-74cf-448f-9022-0cdba8e6aa59 Jul 08 14:49:05 devstack sudo[104417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a1216d81-baf6-49f4-aafc-96e003225d92 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Acquiring lock "cinder-ded548dc-70c2-454b-a235-65f79b0082fa-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a1216d81-baf6-49f4-aafc-96e003225d92 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Lock "cinder-ded548dc-70c2-454b-a235-65f79b0082fa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a1216d81-baf6-49f4-aafc-96e003225d92 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Acquiring lock "cinder-quobyte-ded548dc-70c2-454b-a235-65f79b0082fa" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a1216d81-baf6-49f4-aafc-96e003225d92 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Lock "cinder-quobyte-ded548dc-70c2-454b-a235-65f79b0082fa" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:06 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28b48a6-d9a7-4c0e-9800-821aed131624]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:49:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a1216d81-baf6-49f4-aafc-96e003225d92 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ded548dc-70c2-454b-a235-65f79b0082fa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:06 devstack sudo[104417]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a20dbcbd-8ebc-49fe-a5f2-e18056bc0276 tempest-CreateVolumesFromImageTest-1397772901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3729ac2a-74cf-448f-9022-0cdba8e6aa59" returned: 0 in 0.658s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a20dbcbd-8ebc-49fe-a5f2-e18056bc0276 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "cinder-quobyte-3729ac2a-74cf-448f-9022-0cdba8e6aa59" released by "delete_volume" :: held 1.509s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:06 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-a20dbcbd-8ebc-49fe-a5f2-e18056bc0276 tempest-CreateVolumesFromImageTest-1397772901 None] Created reservations ['af9533bf-1d15-4a2a-b74d-b4fcfefa0093', '6869c8ff-3da4-42b7-880b-60fe54deff70', '2018a5a1-ff30-436a-b849-f7ac2b9af8e3', 'e8c5f7c2-7383-41b0-a07d-8fa4181aec21'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:49:06 devstack sudo[104420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ded548dc-70c2-454b-a235-65f79b0082fa Jul 08 14:49:06 devstack sudo[104420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a20dbcbd-8ebc-49fe-a5f2-e18056bc0276 tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:49:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a20dbcbd-8ebc-49fe-a5f2-e18056bc0276 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:49:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a20dbcbd-8ebc-49fe-a5f2-e18056bc0276 tempest-CreateVolumesFromImageTest-1397772901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:49:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a20dbcbd-8ebc-49fe-a5f2-e18056bc0276 tempest-CreateVolumesFromImageTest-1397772901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:49:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a20dbcbd-8ebc-49fe-a5f2-e18056bc0276 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:49:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a20dbcbd-8ebc-49fe-a5f2-e18056bc0276 tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:06 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:49:06 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-780e2db1-711b-456e-a02b-8fa31c566efb tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "cinder-422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-780e2db1-711b-456e-a02b-8fa31c566efb tempest-CreateVolumesFromImageTest-1397772901 None] Lock "cinder-422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-780e2db1-711b-456e-a02b-8fa31c566efb tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "cinder-quobyte-422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-780e2db1-711b-456e-a02b-8fa31c566efb tempest-CreateVolumesFromImageTest-1397772901 None] Lock "cinder-quobyte-422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:07 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f279bfd-fab4-4858-87a1-e1d8e53c341f]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:49:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-780e2db1-711b-456e-a02b-8fa31c566efb tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:07 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a20dbcbd-8ebc-49fe-a5f2-e18056bc0276 tempest-CreateVolumesFromImageTest-1397772901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.694s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:07 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-a20dbcbd-8ebc-49fe-a5f2-e18056bc0276 tempest-CreateVolumesFromImageTest-1397772901 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:49:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a20dbcbd-8ebc-49fe-a5f2-e18056bc0276 tempest-CreateVolumesFromImageTest-1397772901 None] Deleted volume successfully. Jul 08 14:49:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a20dbcbd-8ebc-49fe-a5f2-e18056bc0276 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "cinder-3729ac2a-74cf-448f-9022-0cdba8e6aa59-delete_volume" released by "delete_volume" :: held 2.405s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:07 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5 Jul 08 14:49:07 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:07 devstack sudo[104420]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a1216d81-baf6-49f4-aafc-96e003225d92 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ded548dc-70c2-454b-a235-65f79b0082fa" returned: 0 in 0.944s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a1216d81-baf6-49f4-aafc-96e003225d92 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ded548dc-70c2-454b-a235-65f79b0082fa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:07 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ded548dc-70c2-454b-a235-65f79b0082fa Jul 08 14:49:07 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:08 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-780e2db1-711b-456e-a02b-8fa31c566efb tempest-CreateVolumesFromImageTest-1397772901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5" returned: 0 in 0.827s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-780e2db1-711b-456e-a02b-8fa31c566efb tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:08 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a1216d81-baf6-49f4-aafc-96e003225d92 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ded548dc-70c2-454b-a235-65f79b0082fa" returned: 0 in 0.733s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:08 devstack sudo[104437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5 Jul 08 14:49:08 devstack sudo[104437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a1216d81-baf6-49f4-aafc-96e003225d92 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Lock "cinder-quobyte-ded548dc-70c2-454b-a235-65f79b0082fa" released by "delete_volume" :: held 1.727s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:08 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-a1216d81-baf6-49f4-aafc-96e003225d92 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Created reservations ['8829269f-7fa7-42ef-bc52-56a034296f57', '98cf93e0-7dbb-4a9e-9548-27e1e3d1b781', '3d95ae1b-f5f1-42ce-b095-1b0558e04ed0', 'cfb18faa-424a-4fb0-87b1-d0cfd00d4a77'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:49:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a1216d81-baf6-49f4-aafc-96e003225d92 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:49:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a1216d81-baf6-49f4-aafc-96e003225d92 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:49:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a1216d81-baf6-49f4-aafc-96e003225d92 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:49:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a1216d81-baf6-49f4-aafc-96e003225d92 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:49:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a1216d81-baf6-49f4-aafc-96e003225d92 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:49:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a1216d81-baf6-49f4-aafc-96e003225d92 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:08 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:49:08 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:08 devstack sudo[104437]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-780e2db1-711b-456e-a02b-8fa31c566efb tempest-CreateVolumesFromImageTest-1397772901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5" returned: 0 in 0.760s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-780e2db1-711b-456e-a02b-8fa31c566efb tempest-CreateVolumesFromImageTest-1397772901 None] Lock "cinder-quobyte-422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5" released by "delete_volume" :: held 1.641s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:08 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-780e2db1-711b-456e-a02b-8fa31c566efb tempest-CreateVolumesFromImageTest-1397772901 None] Created reservations ['303efaa8-f2b4-410e-984e-d58d3a27882a', 'bcb1a37b-fdbc-4feb-ac2b-dc210f4dda2d', '690ef6c1-881c-4d3f-8ace-3df74663de1f', 'cf96c26b-74fe-49a6-9ae4-fcd1ce81536b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:49:08 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a1216d81-baf6-49f4-aafc-96e003225d92 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.722s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:08 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-a1216d81-baf6-49f4-aafc-96e003225d92 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:49:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a1216d81-baf6-49f4-aafc-96e003225d92 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Deleted volume successfully. Jul 08 14:49:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a1216d81-baf6-49f4-aafc-96e003225d92 tempest-TestServerVolumeAttachScenarioOldVersion-64577534 None] Lock "cinder-ded548dc-70c2-454b-a235-65f79b0082fa-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-780e2db1-711b-456e-a02b-8fa31c566efb tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:49:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-780e2db1-711b-456e-a02b-8fa31c566efb tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:49:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-780e2db1-711b-456e-a02b-8fa31c566efb tempest-CreateVolumesFromImageTest-1397772901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:49:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-780e2db1-711b-456e-a02b-8fa31c566efb tempest-CreateVolumesFromImageTest-1397772901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:49:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-780e2db1-711b-456e-a02b-8fa31c566efb tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:49:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-780e2db1-711b-456e-a02b-8fa31c566efb tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:08 devstack sudo[104443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:49:08 devstack sudo[104443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-613b0d37-b576-47b3-b0c7-1ee248276ca8 tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "cinder-a722fe75-558f-418f-8d01-38cf41d67237-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-613b0d37-b576-47b3-b0c7-1ee248276ca8 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "cinder-a722fe75-558f-418f-8d01-38cf41d67237-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-613b0d37-b576-47b3-b0c7-1ee248276ca8 tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "cinder-quobyte-a722fe75-558f-418f-8d01-38cf41d67237" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:49:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-613b0d37-b576-47b3-b0c7-1ee248276ca8 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "cinder-quobyte-a722fe75-558f-418f-8d01-38cf41d67237" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:49:09 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca4c995-7139-4e1d-a467-a77eab87814e]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:49:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-613b0d37-b576-47b3-b0c7-1ee248276ca8 tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a722fe75-558f-418f-8d01-38cf41d67237 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:09 devstack sudo[104445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a722fe75-558f-418f-8d01-38cf41d67237 Jul 08 14:49:09 devstack sudo[104445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:09 devstack sudo[104443]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-780e2db1-711b-456e-a02b-8fa31c566efb tempest-CreateVolumesFromImageTest-1397772901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.704s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:09 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-780e2db1-711b-456e-a02b-8fa31c566efb tempest-CreateVolumesFromImageTest-1397772901 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:49:09 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-780e2db1-711b-456e-a02b-8fa31c566efb tempest-CreateVolumesFromImageTest-1397772901 None] Deleted volume successfully. Jul 08 14:49:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-780e2db1-711b-456e-a02b-8fa31c566efb tempest-CreateVolumesFromImageTest-1397772901 None] Lock "cinder-422e9db6-1ecc-4aa1-b4dd-0c463d40b6e5-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:10 devstack sudo[104445]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-613b0d37-b576-47b3-b0c7-1ee248276ca8 tempest-CreateVolumesFromImageTest-1397772901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a722fe75-558f-418f-8d01-38cf41d67237" returned: 0 in 0.824s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-613b0d37-b576-47b3-b0c7-1ee248276ca8 tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a722fe75-558f-418f-8d01-38cf41d67237 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:10 devstack sudo[104456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a722fe75-558f-418f-8d01-38cf41d67237 Jul 08 14:49:10 devstack sudo[104456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:11 devstack sudo[104456]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-613b0d37-b576-47b3-b0c7-1ee248276ca8 tempest-CreateVolumesFromImageTest-1397772901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a722fe75-558f-418f-8d01-38cf41d67237" returned: 0 in 0.775s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-613b0d37-b576-47b3-b0c7-1ee248276ca8 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "cinder-quobyte-a722fe75-558f-418f-8d01-38cf41d67237" released by "delete_volume" :: held 1.640s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:11 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-613b0d37-b576-47b3-b0c7-1ee248276ca8 tempest-CreateVolumesFromImageTest-1397772901 None] Created reservations ['a081a64d-c449-484d-83e4-c75db46feb74', '8d31a1cb-ea4d-491f-ad70-eccab8dcabe8', '62ec7c56-aad9-4185-bbc0-d884655d8c74', '1003b5a8-8552-44fd-8172-12f1e7a62558'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:49:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-613b0d37-b576-47b3-b0c7-1ee248276ca8 tempest-CreateVolumesFromImageTest-1397772901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:49:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-613b0d37-b576-47b3-b0c7-1ee248276ca8 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:49:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-613b0d37-b576-47b3-b0c7-1ee248276ca8 tempest-CreateVolumesFromImageTest-1397772901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:49:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-613b0d37-b576-47b3-b0c7-1ee248276ca8 tempest-CreateVolumesFromImageTest-1397772901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:49:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-613b0d37-b576-47b3-b0c7-1ee248276ca8 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:49:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-613b0d37-b576-47b3-b0c7-1ee248276ca8 tempest-CreateVolumesFromImageTest-1397772901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:11 devstack sudo[104476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:49:11 devstack sudo[104476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:11 devstack sudo[104476]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-613b0d37-b576-47b3-b0c7-1ee248276ca8 tempest-CreateVolumesFromImageTest-1397772901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.790s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:11 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-613b0d37-b576-47b3-b0c7-1ee248276ca8 tempest-CreateVolumesFromImageTest-1397772901 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:49:11 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-613b0d37-b576-47b3-b0c7-1ee248276ca8 tempest-CreateVolumesFromImageTest-1397772901 None] Deleted volume successfully. Jul 08 14:49:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-613b0d37-b576-47b3-b0c7-1ee248276ca8 tempest-CreateVolumesFromImageTest-1397772901 None] Lock "cinder-a722fe75-558f-418f-8d01-38cf41d67237-delete_volume" released by "delete_volume" :: held 2.676s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:49:21 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=53,cinder:UPDATE=70,cinder:DELETE=8,cinder:INSERT=13 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:49:21 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=56,cinder:UPDATE=81,cinder:INSERT=21,cinder:DELETE=5 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:49:46 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:49:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Flow 'volume_create_manager' (ac8caa45-d957-4adf-8139-96110569c606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:49:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c477a2-531a-42e1-b3d6-ba3c36ad5be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:49:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07c477a2-531a-42e1-b3d6-ba3c36ad5be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1304412640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd50011-daa9-4ee5-aeb3-abb9262b590f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='996b95bb1f724f1d8e2edcf3c293b7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:49:47Z,use_quota=True,user_id='fdef1df6c7234648bb861f25b16c6625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:49:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2ef07e-c8a8-4e1f-840e-0fcf57cbb9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:49:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2ef07e-c8a8-4e1f-840e-0fcf57cbb9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:49:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f993b813-26b8-437f-aca3-2d5e85915491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:49:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f993b813-26b8-437f-aca3-2d5e85915491) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcd50011-daa9-4ee5-aeb3-abb9262b590f', 'volume_name': 'volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:49:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f5640d-1ce8-4687-8e68-c1d1756fea9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:49:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35f5640d-1ce8-4687-8e68-c1d1756fea9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:49:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d88908-7fb2-4c57-976b-f247e783ff12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:49:46 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Volume fcd50011-daa9-4ee5-aeb3-abb9262b590f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f', 'volume_size': 1} Jul 08 14:49:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:49:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:49:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:49:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1304412640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fcd50011-daa9-4ee5-aeb3-abb9262b590f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='996b95bb1f724f1d8e2edcf3c293b7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:49:47Z,use_quota=True,user_id='fdef1df6c7234648bb861f25b16c6625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:49:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Creating volume fcd50011-daa9-4ee5-aeb3-abb9262b590f {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:49:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:49:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:49:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:49:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:49:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:49:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:49:46 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:49:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:46 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f 1073741824 Jul 08 14:49:46 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:47 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f 1073741824" returned: 0 in 0.966s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:47 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f Jul 08 14:49:47 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:49:48 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Jul 08 14:49:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f" returned: 0 in 0.774s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:49:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:49:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:49:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15d88908-7fb2-4c57-976b-f247e783ff12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:49:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c5e145-35f3-49f6-a11e-079250f5d6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:49:48 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Volume volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f (fcd50011-daa9-4ee5-aeb3-abb9262b590f): created successfully Jul 08 14:49:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3c5e145-35f3-49f6-a11e-079250f5d6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:49:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Flow 'volume_create_manager' (ac8caa45-d957-4adf-8139-96110569c606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:49:48 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-88d399fc-00a5-4d1a-8674-91bae9825321 tempest-TestStampPattern-521909082 None] Created volume successfully. Jul 08 14:49:58 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:49:58 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:49:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:49:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:49:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:49:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:49:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:49:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:49:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:49:59 devstack sudo[104633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:49:59 devstack sudo[104633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:50:00 devstack sudo[104633]: pam_unix(sudo:session): session closed for user root Jul 08 14:50:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.676s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:50:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:50:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:50:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:50:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:50:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-b3c8c309-9213-45a4-94d3-e4277f714ce5 req-efaabc1e-4cfa-465d-bac2-0e97777461b5 tempest-TestStampPattern-521909082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:50:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-b3c8c309-9213-45a4-94d3-e4277f714ce5 req-efaabc1e-4cfa-465d-bac2-0e97777461b5 tempest-TestStampPattern-521909082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:50:27 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c2a4a8-a329-4525-b1c1-05b39f887c44]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:50:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-b3c8c309-9213-45a4-94d3-e4277f714ce5 req-efaabc1e-4cfa-465d-bac2-0e97777461b5 tempest-TestStampPattern-521909082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:50:27 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f Jul 08 14:50:27 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:50:27 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Jul 08 14:50:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-b3c8c309-9213-45a4-94d3-e4277f714ce5 req-efaabc1e-4cfa-465d-bac2-0e97777461b5 tempest-TestStampPattern-521909082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f" returned: 0 in 0.792s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:50:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-b3c8c309-9213-45a4-94d3-e4277f714ce5 req-efaabc1e-4cfa-465d-bac2-0e97777461b5 tempest-TestStampPattern-521909082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.808s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:50:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-b3c8c309-9213-45a4-94d3-e4277f714ce5 req-efaabc1e-4cfa-465d-bac2-0e97777461b5 tempest-TestStampPattern-521909082 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad', 'name': 'volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f6e368d1-c3ff-4df7-a4c3-cd81088ebf3e', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:50:27 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-b3c8c309-9213-45a4-94d3-e4277f714ce5 req-efaabc1e-4cfa-465d-bac2-0e97777461b5 tempest-TestStampPattern-521909082 None] attachment_update completed successfully. Jul 08 14:50:36 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-564f3163-3ebb-4deb-98b3-a583d3be14db req-8188eed6-96a7-4b1c-ab7e-aed9905b92b3 tempest-TestStampPattern-521909082 None] Terminate volume connection completed successfully. Jul 08 14:50:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-564f3163-3ebb-4deb-98b3-a583d3be14db req-8188eed6-96a7-4b1c-ab7e-aed9905b92b3 tempest-TestStampPattern-521909082 None] Deleting attachment f6e368d1-c3ff-4df7-a4c3-cd81088ebf3e. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:50:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2512fc31-1f1e-460f-85c9-39d075162f94 tempest-TestStampPattern-521909082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:50:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2512fc31-1f1e-460f-85c9-39d075162f94 tempest-TestStampPattern-521909082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:50:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-2512fc31-1f1e-460f-85c9-39d075162f94 tempest-TestStampPattern-521909082 None] Creating offline snapshot 4315f12f-6a8c-4708-be53-1843360c0d6d of volume fcd50011-daa9-4ee5-aeb3-abb9262b590f {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:50:38 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5def1774-4a07-4037-a069-adc78e57882a]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:50:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2512fc31-1f1e-460f-85c9-39d075162f94 tempest-TestStampPattern-521909082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:50:38 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f Jul 08 14:50:38 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:50:38 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Jul 08 14:50:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2512fc31-1f1e-460f-85c9-39d075162f94 tempest-TestStampPattern-521909082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f" returned: 0 in 0.729s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:50:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2512fc31-1f1e-460f-85c9-39d075162f94 tempest-TestStampPattern-521909082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.4315f12f-6a8c-4708-be53-1843360c0d6d 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:50:38 devstack sudo[105125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.4315f12f-6a8c-4708-be53-1843360c0d6d 1G Jul 08 14:50:38 devstack sudo[105125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:50:39 devstack sudo[105125]: pam_unix(sudo:session): session closed for user root Jul 08 14:50:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2512fc31-1f1e-460f-85c9-39d075162f94 tempest-TestStampPattern-521909082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.4315f12f-6a8c-4708-be53-1843360c0d6d 1G" returned: 0 in 0.750s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:50:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2512fc31-1f1e-460f-85c9-39d075162f94 tempest-TestStampPattern-521909082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.4315f12f-6a8c-4708-be53-1843360c0d6d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:50:39 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.4315f12f-6a8c-4708-be53-1843360c0d6d Jul 08 14:50:39 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:50:40 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Jul 08 14:50:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2512fc31-1f1e-460f-85c9-39d075162f94 tempest-TestStampPattern-521909082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.4315f12f-6a8c-4708-be53-1843360c0d6d" returned: 0 in 0.665s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:50:40 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-2512fc31-1f1e-460f-85c9-39d075162f94 tempest-TestStampPattern-521909082 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.4315f12f-6a8c-4708-be53-1843360c0d6d is being set with open permissions: ugo+rw Jul 08 14:50:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2512fc31-1f1e-460f-85c9-39d075162f94 tempest-TestStampPattern-521909082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.4315f12f-6a8c-4708-be53-1843360c0d6d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:50:40 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.4315f12f-6a8c-4708-be53-1843360c0d6d Jul 08 14:50:40 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:50:40 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 08 14:50:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2512fc31-1f1e-460f-85c9-39d075162f94 tempest-TestStampPattern-521909082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.4315f12f-6a8c-4708-be53-1843360c0d6d" returned: 0 in 0.616s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:50:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2512fc31-1f1e-460f-85c9-39d075162f94 tempest-TestStampPattern-521909082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:50:41 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.info Jul 08 14:50:41 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:50:41 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Jul 08 14:50:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2512fc31-1f1e-460f-85c9-39d075162f94 tempest-TestStampPattern-521909082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.info" returned: 0 in 0.618s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:50:41 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-2512fc31-1f1e-460f-85c9-39d075162f94 tempest-TestStampPattern-521909082 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.info is being set with open permissions: ugo+rw Jul 08 14:50:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2512fc31-1f1e-460f-85c9-39d075162f94 tempest-TestStampPattern-521909082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:50:41 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.info Jul 08 14:50:41 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:50:42 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Jul 08 14:50:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2512fc31-1f1e-460f-85c9-39d075162f94 tempest-TestStampPattern-521909082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.info" returned: 0 in 0.647s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:50:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2512fc31-1f1e-460f-85c9-39d075162f94 tempest-TestStampPattern-521909082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.104s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:50:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2512fc31-1f1e-460f-85c9-39d075162f94 tempest-TestStampPattern-521909082 None] Create snapshot completed successfully Jul 08 14:50:52 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:50:52 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=8,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:50:52 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Flow 'volume_create_manager' (0bb874a0-02b8-452f-a7fb-09041b210bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7b5e35-f082-4ff9-b735-436e49a13c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b7b5e35-f082-4ff9-b735-436e49a13c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:50:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-154505154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57bbf489-a274-4189-9cf3-ecb602500786,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='996b95bb1f724f1d8e2edcf3c293b7d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:50:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4315f12f-6a8c-4708-be53-1843360c0d6d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:50:53Z,use_quota=True,user_id='fdef1df6c7234648bb861f25b16c6625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9561152-93ee-445e-978d-f44a7aec632c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9561152-93ee-445e-978d-f44a7aec632c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfde6641-99e3-4ee4-a3a3-d6ef4ca8ef00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfde6641-99e3-4ee4-a3a3-d6ef4ca8ef00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '57bbf489-a274-4189-9cf3-ecb602500786', 'volume_name': 'volume-57bbf489-a274-4189-9cf3-ecb602500786', 'volume_size': 1, 'snapshot_id': '4315f12f-6a8c-4708-be53-1843360c0d6d'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e92d63-1939-44da-ad0a-257c8d5fb6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e92d63-1939-44da-ad0a-257c8d5fb6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee54d1d1-dc8d-4d5f-8e80-2bf6d3d0cb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:50:53 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Volume 57bbf489-a274-4189-9cf3-ecb602500786: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-57bbf489-a274-4189-9cf3-ecb602500786', 'volume_size': 1, 'snapshot_id': '4315f12f-6a8c-4708-be53-1843360c0d6d'} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Acquiring lock "cinder-quobyte-4315f12f-6a8c-4708-be53-1843360c0d6d-57bbf489-a274-4189-9cf3-ecb602500786" by "_create_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Lock "cinder-quobyte-4315f12f-6a8c-4708-be53-1843360c0d6d-57bbf489-a274-4189-9cf3-ecb602500786" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Creating volume 57bbf489-a274-4189-9cf3-ecb602500786 from snapshot 4315f12f-6a8c-4708-be53-1843360c0d6d {{(pid=87240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Acquiring lock "cinder-quobyte-57bbf489-a274-4189-9cf3-ecb602500786" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Lock "cinder-quobyte-57bbf489-a274-4189-9cf3-ecb602500786" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] snapshot: 4315f12f-6a8c-4708-be53-1843360c0d6d, volume: 57bbf489-a274-4189-9cf3-ecb602500786, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5155c04-b3be-4cb8-b053-43acb3d8b0f7]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.4315f12f-6a8c-4708-be53-1843360c0d6d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:50:53 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.4315f12f-6a8c-4708-be53-1843360c0d6d Jul 08 14:50:53 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:50:53 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.4315f12f-6a8c-4708-be53-1843360c0d6d" returned: 0 in 0.788s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9a5c78-4ee4-434f-a37e-890c9a2d078b]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:50:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:50:54 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f Jul 08 14:50:54 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:50:54 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Jul 08 14:50:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f" returned: 0 in 0.765s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:50:54 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Path /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-57bbf489-a274-4189-9cf3-ecb602500786 not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:50:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-57bbf489-a274-4189-9cf3-ecb602500786 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:50:54 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-57bbf489-a274-4189-9cf3-ecb602500786 Jul 08 14:50:54 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:50:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:50:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:50:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:50:59 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jul 08 14:50:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-57bbf489-a274-4189-9cf3-ecb602500786" returned: 0 in 4.902s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:50:59 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1f3aa4-b5c5-4eaf-906f-77c2d84cafe8]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:50:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:50:59 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f Jul 08 14:50:59 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:00 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f" returned: 0 in 1.016s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:00 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Image conversion details: src /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f, size 1024.00 MB, duration 4.90 sec, destination /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-57bbf489-a274-4189-9cf3-ecb602500786 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:51:00 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Converted 1024.00 MB image at 208.84 MB/s Jul 08 14:51:00 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-57bbf489-a274-4189-9cf3-ecb602500786 is being set with open permissions: ugo+rw Jul 08 14:51:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-57bbf489-a274-4189-9cf3-ecb602500786 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:00 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-57bbf489-a274-4189-9cf3-ecb602500786 Jul 08 14:51:00 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:01 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-57bbf489-a274-4189-9cf3-ecb602500786" returned: 0 in 0.856s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Lock "cinder-quobyte-57bbf489-a274-4189-9cf3-ecb602500786" released by "_copy_volume_from_snapshot" :: held 8.433s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:51:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Lock "cinder-quobyte-4315f12f-6a8c-4708-be53-1843360c0d6d-57bbf489-a274-4189-9cf3-ecb602500786" released by "_create_volume_from_snapshot" :: held 8.472s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:51:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.489s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:51:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee54d1d1-dc8d-4d5f-8e80-2bf6d3d0cb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57bbf489-a274-4189-9cf3-ecb602500786', 'volume_size': 1, 'snapshot_id': '4315f12f-6a8c-4708-be53-1843360c0d6d'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:51:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d786edfa-ddd4-471f-958b-29dfd3d46a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:51:01 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Volume volume-57bbf489-a274-4189-9cf3-ecb602500786 (57bbf489-a274-4189-9cf3-ecb602500786): created successfully Jul 08 14:51:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d786edfa-ddd4-471f-958b-29dfd3d46a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:51:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Flow 'volume_create_manager' (0bb874a0-02b8-452f-a7fb-09041b210bc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:51:01 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ac867c6b-bda8-4f41-b414-51fb4061b76e tempest-TestStampPattern-521909082 None] Created volume successfully. Jul 08 14:51:11 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:51:11 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:51:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-c03e1e1f-ee21-41ab-959f-c33e512b8f94 req-fdbf3f0d-2b05-4f56-8d71-f7ee658c124e tempest-TestStampPattern-521909082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:51:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-c03e1e1f-ee21-41ab-959f-c33e512b8f94 req-fdbf3f0d-2b05-4f56-8d71-f7ee658c124e tempest-TestStampPattern-521909082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:51:50 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9648a75e-74d9-40f1-95d7-51069f9e3022]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:51:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-c03e1e1f-ee21-41ab-959f-c33e512b8f94 req-fdbf3f0d-2b05-4f56-8d71-f7ee658c124e tempest-TestStampPattern-521909082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-57bbf489-a274-4189-9cf3-ecb602500786 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:50 devstack sudo[105375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-57bbf489-a274-4189-9cf3-ecb602500786 Jul 08 14:51:50 devstack sudo[105375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:51:51 devstack sudo[105375]: pam_unix(sudo:session): session closed for user root Jul 08 14:51:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [req-c03e1e1f-ee21-41ab-959f-c33e512b8f94 req-fdbf3f0d-2b05-4f56-8d71-f7ee658c124e tempest-TestStampPattern-521909082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-57bbf489-a274-4189-9cf3-ecb602500786" returned: 0 in 0.759s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:51:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [req-c03e1e1f-ee21-41ab-959f-c33e512b8f94 req-fdbf3f0d-2b05-4f56-8d71-f7ee658c124e tempest-TestStampPattern-521909082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.776s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:51:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-c03e1e1f-ee21-41ab-959f-c33e512b8f94 req-fdbf3f0d-2b05-4f56-8d71-f7ee658c124e tempest-TestStampPattern-521909082 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad', 'name': 'volume-57bbf489-a274-4189-9cf3-ecb602500786', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b246ef6-d8e0-450b-bc78-5afa06660cf8', 'enforce_multipath': True} {{(pid=87240) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 14:51:51 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-c03e1e1f-ee21-41ab-959f-c33e512b8f94 req-fdbf3f0d-2b05-4f56-8d71-f7ee658c124e tempest-TestStampPattern-521909082 None] attachment_update completed successfully. Jul 08 14:51:58 devstack cinder-volume[87240]: INFO cinder.volume.manager [req-0fa55adb-b295-4457-a101-8b03b1b37e93 req-3c827933-3f3c-46e6-9f0c-b5a1e9210a8c tempest-TestStampPattern-521909082 None] Terminate volume connection completed successfully. Jul 08 14:51:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [req-0fa55adb-b295-4457-a101-8b03b1b37e93 req-3c827933-3f3c-46e6-9f0c-b5a1e9210a8c tempest-TestStampPattern-521909082 None] Deleting attachment 9b246ef6-d8e0-450b-bc78-5afa06660cf8. {{(pid=87240) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 14:51:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:51:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:51:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:51:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:51:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:51:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:51:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:51:59 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:51:59 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:00 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.675s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:52:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:52:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:52:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:52:08 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:52:08 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=3,cinder:SELECT=6 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:52:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e41dfa8b-2bc2-4d4d-a12b-3264693da0a5 tempest-TestStampPattern-521909082 None] Acquiring lock "cinder-57bbf489-a274-4189-9cf3-ecb602500786-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e41dfa8b-2bc2-4d4d-a12b-3264693da0a5 tempest-TestStampPattern-521909082 None] Lock "cinder-57bbf489-a274-4189-9cf3-ecb602500786-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e41dfa8b-2bc2-4d4d-a12b-3264693da0a5 tempest-TestStampPattern-521909082 None] Acquiring lock "cinder-quobyte-57bbf489-a274-4189-9cf3-ecb602500786" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e41dfa8b-2bc2-4d4d-a12b-3264693da0a5 tempest-TestStampPattern-521909082 None] Lock "cinder-quobyte-57bbf489-a274-4189-9cf3-ecb602500786" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:08 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5175696-f6e4-4174-b2e0-b13945d91a79]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e41dfa8b-2bc2-4d4d-a12b-3264693da0a5 tempest-TestStampPattern-521909082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-57bbf489-a274-4189-9cf3-ecb602500786 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:08 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-57bbf489-a274-4189-9cf3-ecb602500786 Jul 08 14:52:08 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:08 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e41dfa8b-2bc2-4d4d-a12b-3264693da0a5 tempest-TestStampPattern-521909082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-57bbf489-a274-4189-9cf3-ecb602500786" returned: 0 in 0.762s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e41dfa8b-2bc2-4d4d-a12b-3264693da0a5 tempest-TestStampPattern-521909082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-57bbf489-a274-4189-9cf3-ecb602500786 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:09 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-57bbf489-a274-4189-9cf3-ecb602500786 Jul 08 14:52:09 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:09 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e41dfa8b-2bc2-4d4d-a12b-3264693da0a5 tempest-TestStampPattern-521909082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-57bbf489-a274-4189-9cf3-ecb602500786" returned: 0 in 0.644s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e41dfa8b-2bc2-4d4d-a12b-3264693da0a5 tempest-TestStampPattern-521909082 None] Lock "cinder-quobyte-57bbf489-a274-4189-9cf3-ecb602500786" released by "delete_volume" :: held 1.448s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:09 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-e41dfa8b-2bc2-4d4d-a12b-3264693da0a5 tempest-TestStampPattern-521909082 None] Created reservations ['898da525-359c-409f-ba36-f9e122305566', '908b5dfa-e85d-4e49-a3ee-3f1d9d47373a', '9e5a02d6-99c0-40d8-bfdd-2664eafc13da', '10ead6da-0c1b-418e-a793-7429ae242b2c'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:52:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e41dfa8b-2bc2-4d4d-a12b-3264693da0a5 tempest-TestStampPattern-521909082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e41dfa8b-2bc2-4d4d-a12b-3264693da0a5 tempest-TestStampPattern-521909082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e41dfa8b-2bc2-4d4d-a12b-3264693da0a5 tempest-TestStampPattern-521909082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e41dfa8b-2bc2-4d4d-a12b-3264693da0a5 tempest-TestStampPattern-521909082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e41dfa8b-2bc2-4d4d-a12b-3264693da0a5 tempest-TestStampPattern-521909082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e41dfa8b-2bc2-4d4d-a12b-3264693da0a5 tempest-TestStampPattern-521909082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:09 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:52:09 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:10 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e41dfa8b-2bc2-4d4d-a12b-3264693da0a5 tempest-TestStampPattern-521909082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.667s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:10 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-e41dfa8b-2bc2-4d4d-a12b-3264693da0a5 tempest-TestStampPattern-521909082 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:52:10 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e41dfa8b-2bc2-4d4d-a12b-3264693da0a5 tempest-TestStampPattern-521909082 None] Deleted volume successfully. Jul 08 14:52:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e41dfa8b-2bc2-4d4d-a12b-3264693da0a5 tempest-TestStampPattern-521909082 None] Lock "cinder-57bbf489-a274-4189-9cf3-ecb602500786-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8954c098-9891-48c7-ab04-9b58d9a587a9 tempest-TestStampPattern-521909082 None] Acquiring lock "cinder-4315f12f-6a8c-4708-be53-1843360c0d6d-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8954c098-9891-48c7-ab04-9b58d9a587a9 tempest-TestStampPattern-521909082 None] Lock "cinder-4315f12f-6a8c-4708-be53-1843360c0d6d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8954c098-9891-48c7-ab04-9b58d9a587a9 tempest-TestStampPattern-521909082 None] Acquiring lock "cinder-quobyte-fcd50011-daa9-4ee5-aeb3-abb9262b590f" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8954c098-9891-48c7-ab04-9b58d9a587a9 tempest-TestStampPattern-521909082 None] Lock "cinder-quobyte-fcd50011-daa9-4ee5-aeb3-abb9262b590f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8954c098-9891-48c7-ab04-9b58d9a587a9 tempest-TestStampPattern-521909082 None] Acquiring lock "cinder-quobyte-4315f12f-6a8c-4708-be53-1843360c0d6d" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8954c098-9891-48c7-ab04-9b58d9a587a9 tempest-TestStampPattern-521909082 None] Lock "cinder-quobyte-4315f12f-6a8c-4708-be53-1843360c0d6d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8954c098-9891-48c7-ab04-9b58d9a587a9 tempest-TestStampPattern-521909082 None] Deleting offline snapshot 4315f12f-6a8c-4708-be53-1843360c0d6d of volume fcd50011-daa9-4ee5-aeb3-abb9262b590f {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:52:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8954c098-9891-48c7-ab04-9b58d9a587a9 tempest-TestStampPattern-521909082 None] snapshot_file for this snap is: volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.4315f12f-6a8c-4708-be53-1843360c0d6d {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:52:10 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b499c3-15fc-4f94-bc6a-a67a3d75a004]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8954c098-9891-48c7-ab04-9b58d9a587a9 tempest-TestStampPattern-521909082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.4315f12f-6a8c-4708-be53-1843360c0d6d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:10 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.4315f12f-6a8c-4708-be53-1843360c0d6d Jul 08 14:52:10 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:11 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8954c098-9891-48c7-ab04-9b58d9a587a9 tempest-TestStampPattern-521909082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.4315f12f-6a8c-4708-be53-1843360c0d6d" returned: 0 in 0.745s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8954c098-9891-48c7-ab04-9b58d9a587a9 tempest-TestStampPattern-521909082 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:52:11 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89793a6-83a0-4d44-b4b7-0985f24e2c42]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8954c098-9891-48c7-ab04-9b58d9a587a9 tempest-TestStampPattern-521909082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:11 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f Jul 08 14:52:11 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:12 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8954c098-9891-48c7-ab04-9b58d9a587a9 tempest-TestStampPattern-521909082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f" returned: 0 in 0.740s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8954c098-9891-48c7-ab04-9b58d9a587a9 tempest-TestStampPattern-521909082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.4315f12f-6a8c-4708-be53-1843360c0d6d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:12 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.4315f12f-6a8c-4708-be53-1843360c0d6d Jul 08 14:52:12 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:12 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8954c098-9891-48c7-ab04-9b58d9a587a9 tempest-TestStampPattern-521909082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.4315f12f-6a8c-4708-be53-1843360c0d6d" returned: 0 in 0.723s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8954c098-9891-48c7-ab04-9b58d9a587a9 tempest-TestStampPattern-521909082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.4315f12f-6a8c-4708-be53-1843360c0d6d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:12 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.4315f12f-6a8c-4708-be53-1843360c0d6d Jul 08 14:52:12 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:13 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8954c098-9891-48c7-ab04-9b58d9a587a9 tempest-TestStampPattern-521909082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f.4315f12f-6a8c-4708-be53-1843360c0d6d" returned: 0 in 0.648s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8954c098-9891-48c7-ab04-9b58d9a587a9 tempest-TestStampPattern-521909082 None] Lock "cinder-quobyte-4315f12f-6a8c-4708-be53-1843360c0d6d" released by "_delete_snapshot" :: held 2.962s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8954c098-9891-48c7-ab04-9b58d9a587a9 tempest-TestStampPattern-521909082 None] Lock "cinder-quobyte-fcd50011-daa9-4ee5-aeb3-abb9262b590f" released by "delete_snapshot" :: held 2.988s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:13 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-8954c098-9891-48c7-ab04-9b58d9a587a9 tempest-TestStampPattern-521909082 None] Created reservations ['63d56bba-3c6f-459a-b93f-984c095fde85', '0f270150-f132-4a82-bb1f-5a059d276392', '37357364-a8ba-43bb-b269-a0b15b96beaf', 'e3be50dd-cbb1-4a02-9144-692f7e9b4c42'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:52:13 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8954c098-9891-48c7-ab04-9b58d9a587a9 tempest-TestStampPattern-521909082 None] Delete snapshot completed successfully. Jul 08 14:52:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8954c098-9891-48c7-ab04-9b58d9a587a9 tempest-TestStampPattern-521909082 None] Lock "cinder-4315f12f-6a8c-4708-be53-1843360c0d6d-delete_snapshot" released by "delete_snapshot" :: held 3.143s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-571f3e48-35dc-40a3-b89d-099e3b3844d7 tempest-TestStampPattern-521909082 None] Acquiring lock "cinder-fcd50011-daa9-4ee5-aeb3-abb9262b590f-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-571f3e48-35dc-40a3-b89d-099e3b3844d7 tempest-TestStampPattern-521909082 None] Lock "cinder-fcd50011-daa9-4ee5-aeb3-abb9262b590f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-571f3e48-35dc-40a3-b89d-099e3b3844d7 tempest-TestStampPattern-521909082 None] Acquiring lock "cinder-quobyte-fcd50011-daa9-4ee5-aeb3-abb9262b590f" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-571f3e48-35dc-40a3-b89d-099e3b3844d7 tempest-TestStampPattern-521909082 None] Lock "cinder-quobyte-fcd50011-daa9-4ee5-aeb3-abb9262b590f" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:20 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7396482d-baed-4fd9-848e-c4ce1989768f]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-571f3e48-35dc-40a3-b89d-099e3b3844d7 tempest-TestStampPattern-521909082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:21 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f Jul 08 14:52:21 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:21 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-571f3e48-35dc-40a3-b89d-099e3b3844d7 tempest-TestStampPattern-521909082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f" returned: 0 in 0.721s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-571f3e48-35dc-40a3-b89d-099e3b3844d7 tempest-TestStampPattern-521909082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:21 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f Jul 08 14:52:21 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:22 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-571f3e48-35dc-40a3-b89d-099e3b3844d7 tempest-TestStampPattern-521909082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-fcd50011-daa9-4ee5-aeb3-abb9262b590f" returned: 0 in 0.625s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-571f3e48-35dc-40a3-b89d-099e3b3844d7 tempest-TestStampPattern-521909082 None] Lock "cinder-quobyte-fcd50011-daa9-4ee5-aeb3-abb9262b590f" released by "delete_volume" :: held 1.405s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:22 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-571f3e48-35dc-40a3-b89d-099e3b3844d7 tempest-TestStampPattern-521909082 None] Created reservations ['bb11bdbd-69eb-403c-9fbe-1fc4d3698b1d', '9f963353-1bc4-443d-931f-066fb901ba79', 'eb9dd208-2062-4748-a6a9-608fc0c658f1', 'a82d9790-0c9b-439a-bf86-f93a859f0e39'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:52:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-571f3e48-35dc-40a3-b89d-099e3b3844d7 tempest-TestStampPattern-521909082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-571f3e48-35dc-40a3-b89d-099e3b3844d7 tempest-TestStampPattern-521909082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-571f3e48-35dc-40a3-b89d-099e3b3844d7 tempest-TestStampPattern-521909082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-571f3e48-35dc-40a3-b89d-099e3b3844d7 tempest-TestStampPattern-521909082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-571f3e48-35dc-40a3-b89d-099e3b3844d7 tempest-TestStampPattern-521909082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-571f3e48-35dc-40a3-b89d-099e3b3844d7 tempest-TestStampPattern-521909082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:22 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:52:22 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:23 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-571f3e48-35dc-40a3-b89d-099e3b3844d7 tempest-TestStampPattern-521909082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.617s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:23 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-571f3e48-35dc-40a3-b89d-099e3b3844d7 tempest-TestStampPattern-521909082 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:52:23 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-571f3e48-35dc-40a3-b89d-099e3b3844d7 tempest-TestStampPattern-521909082 None] Deleted volume successfully. Jul 08 14:52:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-571f3e48-35dc-40a3-b89d-099e3b3844d7 tempest-TestStampPattern-521909082 None] Lock "cinder-fcd50011-daa9-4ee5-aeb3-abb9262b590f-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:32 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=18,cinder:UPDATE=24,cinder:INSERT=5 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:52:33 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=13,cinder:INSERT=7,cinder:UPDATE=19,cinder:DELETE=2 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:52:36 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:52:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Flow 'volume_create_manager' (9bebab5b-8c3d-4db5-ba67-d45557f0875f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4165be7d-01b2-4ede-bd98-9b4ebe594069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4165be7d-01b2-4ede-bd98-9b4ebe594069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22716705-dd38-427f-aab8-04ba190c7199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72593454cbbe4f03bae4cdbd33874261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:37Z,use_quota=True,user_id='65657f4183c042ca81263fad1d1a4602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ecc27b1-8a45-4655-809a-a1d5ed68c040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ecc27b1-8a45-4655-809a-a1d5ed68c040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19f3c37-c6f1-442f-9870-11b2f5f1ce46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:36 devstack cinder-volume[87240]: DEBUG cinder.image.glance [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Creating Keystone auth plugin from conf {{(pid=87240) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 14:52:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e19f3c37-c6f1-442f-9870-11b2f5f1ce46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '22716705-dd38-427f-aab8-04ba190c7199', 'volume_name': 'volume-22716705-dd38-427f-aab8-04ba190c7199', 'volume_size': 1, 'image_id': 'b1336860-0faa-4265-b319-8d177c139716', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1336860-0faa-4265-b319-8d177c139716', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5999c757f452d3a19c3deba1c9001d70', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '72593454cbbe4f03bae4cdbd33874261', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f9010bb18cebddbe7ca32465b5af7d13c6f00facfd6c973f6155ed4f670eea63c28ab33e7d79bc3e3ef0d22c5878e9b75e249d84deb66fb0461e5338e7806fc3', 'id': 'b1336860-0faa-4265-b319-8d177c139716', 'created_at': datetime.datetime(2026, 7, 8, 12, 52, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 52, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1336860-0faa-4265-b319-8d177c139716/file', 'properties': {}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f058110f-82a8-404c-8a09-6f7877ec1659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f058110f-82a8-404c-8a09-6f7877ec1659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (082986e5-60c4-4ded-9fcf-de8f22244668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:36 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Volume 22716705-dd38-427f-aab8-04ba190c7199: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-22716705-dd38-427f-aab8-04ba190c7199', 'volume_size': 1, 'image_id': 'b1336860-0faa-4265-b319-8d177c139716', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1336860-0faa-4265-b319-8d177c139716', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5999c757f452d3a19c3deba1c9001d70', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '72593454cbbe4f03bae4cdbd33874261', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f9010bb18cebddbe7ca32465b5af7d13c6f00facfd6c973f6155ed4f670eea63c28ab33e7d79bc3e3ef0d22c5878e9b75e249d84deb66fb0461e5338e7806fc3', 'id': 'b1336860-0faa-4265-b319-8d177c139716', 'created_at': datetime.datetime(2026, 7, 8, 12, 52, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 52, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1336860-0faa-4265-b319-8d177c139716/file', 'properties': {}}, 'image_service': } Jul 08 14:52:36 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Trying to clone 22716705-dd38-427f-aab8-04ba190c7199 from image b1336860-0faa-4265-b319-8d177c139716 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b1336860-0faa-4265-b319-8d177c139716', 'metadata': {}}]). {{(pid=87240) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 14:52:37 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 14:52:37 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Image download 0.00 MB at 0.00 MB/s Jul 08 14:52:37 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c13a7e9-f978-47ff-94ff-2248a6796261]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:37 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD Jul 08 14:52:37 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:37 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD" returned: 0 in 0.747s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:37 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD Jul 08 14:52:37 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:38 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD" returned: 1 in 0.702s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:52:38 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Temporary image b1336860-0faa-4265-b319-8d177c139716 is fetched for user 65657f4183c042ca81263fad1d1a4602. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 14:52:38 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[913f8404-fa0e-4c13-b52c-f5aa0f35d962]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:38 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD Jul 08 14:52:38 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:39 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD" returned: 0 in 0.731s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:39 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD Jul 08 14:52:39 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:40 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD" returned: 1 in 0.733s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:52:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:52:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22716705-dd38-427f-aab8-04ba190c7199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72593454cbbe4f03bae4cdbd33874261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:52:37Z,use_quota=True,user_id='65657f4183c042ca81263fad1d1a4602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:52:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Creating volume 22716705-dd38-427f-aab8-04ba190c7199 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:52:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:52:40 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:52:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:40 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199 1073741824 Jul 08 14:52:40 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:40 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199 1073741824" returned: 0 in 0.818s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:40 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199 Jul 08 14:52:40 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:41 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199" returned: 0 in 0.665s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:52:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:41 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Attempting download of b1336860-0faa-4265-b319-8d177c139716 ((None, [{'url': 'file:///opt/stack/data/glance/images/b1336860-0faa-4265-b319-8d177c139716', 'metadata': {}}])) to volume 22716705-dd38-427f-aab8-04ba190c7199. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 14:52:41 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f6a928-aa64-4471-ae80-951a1df0b641]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1336860-0faa-4265-b319-8d177c139716_0amsr725 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:41 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1336860-0faa-4265-b319-8d177c139716_0amsr725 Jul 08 14:52:41 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:42 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b1336860-0faa-4265-b319-8d177c139716_0amsr725" returned: 0 in 0.732s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1336860-0faa-4265-b319-8d177c139716_0amsr725 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:42 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1336860-0faa-4265-b319-8d177c139716_0amsr725 Jul 08 14:52:42 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:43 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1336860-0faa-4265-b319-8d177c139716_0amsr725" returned: 1 in 0.703s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b1336860-0faa-4265-b319-8d177c139716_0amsr725' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:52:43 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[159ece4d-afd6-4372-b3af-fc682a58e149]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:43 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD Jul 08 14:52:43 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:43 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD" returned: 0 in 0.729s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:43 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD Jul 08 14:52:43 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:44 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD" returned: 1 in 0.825s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:52:44 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] b1336860-0faa-4265-b319-8d177c139716 was raw, converting to raw {{(pid=87240) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 14:52:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:44 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199 Jul 08 14:52:44 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:45 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199" returned: 0 in 0.745s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:45 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b1336860-0faa-4265-b319-8d177c139716_hxsx336xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:52:45 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 14:52:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:45 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199 1G Jul 08 14:52:45 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:46 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199 1G" returned: 0 in 0.719s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:46 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[33756fe0-0816-4081-8702-6f0efaf77061]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:46 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199 Jul 08 14:52:46 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:46 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199" returned: 0 in 0.761s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:47 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199 Jul 08 14:52:47 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:47 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199" returned: 1 in 0.763s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:52:47 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Downloaded image b1336860-0faa-4265-b319-8d177c139716 ((None, [{'url': 'file:///opt/stack/data/glance/images/b1336860-0faa-4265-b319-8d177c139716', 'metadata': {}}])) to volume 22716705-dd38-427f-aab8-04ba190c7199 successfully. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 14:52:47 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Temporary image b1336860-0faa-4265-b319-8d177c139716 for user 65657f4183c042ca81263fad1d1a4602 is deleted. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 14:52:47 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Marking volume 22716705-dd38-427f-aab8-04ba190c7199 as bootable. {{(pid=87240) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 14:52:47 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Copying metadata from image b1336860-0faa-4265-b319-8d177c139716 to 22716705-dd38-427f-aab8-04ba190c7199. {{(pid=87240) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 14:52:47 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Creating volume glance metadata for volume 22716705-dd38-427f-aab8-04ba190c7199 backed by image b1336860-0faa-4265-b319-8d177c139716 with: {'image_id': 'b1336860-0faa-4265-b319-8d177c139716', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5999c757f452d3a19c3deba1c9001d70', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87240) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 14:52:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (082986e5-60c4-4ded-9fcf-de8f22244668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22716705-dd38-427f-aab8-04ba190c7199', 'volume_size': 1, 'image_id': 'b1336860-0faa-4265-b319-8d177c139716', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b1336860-0faa-4265-b319-8d177c139716', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5999c757f452d3a19c3deba1c9001d70', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '72593454cbbe4f03bae4cdbd33874261', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f9010bb18cebddbe7ca32465b5af7d13c6f00facfd6c973f6155ed4f670eea63c28ab33e7d79bc3e3ef0d22c5878e9b75e249d84deb66fb0461e5338e7806fc3', 'id': 'b1336860-0faa-4265-b319-8d177c139716', 'created_at': datetime.datetime(2026, 7, 8, 12, 52, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 52, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b1336860-0faa-4265-b319-8d177c139716/file', 'properties': {}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31630de4-d76c-4db5-bf51-5e0ae0fbafb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:52:47 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Volume volume-22716705-dd38-427f-aab8-04ba190c7199 (22716705-dd38-427f-aab8-04ba190c7199): created successfully Jul 08 14:52:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31630de4-d76c-4db5-bf51-5e0ae0fbafb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:52:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Flow 'volume_create_manager' (9bebab5b-8c3d-4db5-ba67-d45557f0875f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:52:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6b74f437-87a1-4330-9ca2-1b932ab2fe8e tempest-VolumeImageDependencyTests-923660300 None] Created volume successfully. Jul 08 14:52:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-74ff382a-1ba5-4fdf-9051-d8da6eee8a7d tempest-VolumeImageDependencyTests-923660300 None] Acquiring lock "cinder-22716705-dd38-427f-aab8-04ba190c7199-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-74ff382a-1ba5-4fdf-9051-d8da6eee8a7d tempest-VolumeImageDependencyTests-923660300 None] Lock "cinder-22716705-dd38-427f-aab8-04ba190c7199-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-74ff382a-1ba5-4fdf-9051-d8da6eee8a7d tempest-VolumeImageDependencyTests-923660300 None] Acquiring lock "cinder-quobyte-22716705-dd38-427f-aab8-04ba190c7199" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:52:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-74ff382a-1ba5-4fdf-9051-d8da6eee8a7d tempest-VolumeImageDependencyTests-923660300 None] Lock "cinder-quobyte-22716705-dd38-427f-aab8-04ba190c7199" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:52:48 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e574c9c0-608b-4524-adff-bea769b8a5fb]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:52:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-74ff382a-1ba5-4fdf-9051-d8da6eee8a7d tempest-VolumeImageDependencyTests-923660300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:48 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199 Jul 08 14:52:48 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:49 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-74ff382a-1ba5-4fdf-9051-d8da6eee8a7d tempest-VolumeImageDependencyTests-923660300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199" returned: 0 in 0.787s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-74ff382a-1ba5-4fdf-9051-d8da6eee8a7d tempest-VolumeImageDependencyTests-923660300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:49 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199 Jul 08 14:52:49 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:49 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-74ff382a-1ba5-4fdf-9051-d8da6eee8a7d tempest-VolumeImageDependencyTests-923660300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199" returned: 1 in 0.730s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-74ff382a-1ba5-4fdf-9051-d8da6eee8a7d tempest-VolumeImageDependencyTests-923660300 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:52:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-74ff382a-1ba5-4fdf-9051-d8da6eee8a7d tempest-VolumeImageDependencyTests-923660300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:49 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199 Jul 08 14:52:49 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:50 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-74ff382a-1ba5-4fdf-9051-d8da6eee8a7d tempest-VolumeImageDependencyTests-923660300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-22716705-dd38-427f-aab8-04ba190c7199" returned: 0 in 0.623s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-74ff382a-1ba5-4fdf-9051-d8da6eee8a7d tempest-VolumeImageDependencyTests-923660300 None] Lock "cinder-quobyte-22716705-dd38-427f-aab8-04ba190c7199" released by "delete_volume" :: held 2.197s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:50 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-74ff382a-1ba5-4fdf-9051-d8da6eee8a7d tempest-VolumeImageDependencyTests-923660300 None] Created reservations ['34cf6053-3b0c-45b3-8fd0-795f96f10681', 'f514c596-a0ee-4c49-b627-14fa4d15ee73', '186aceeb-165e-4d78-ac7c-bf5b4f76f522', 'a07a9fa0-220d-452c-9f8b-069780f868aa'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:52:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-74ff382a-1ba5-4fdf-9051-d8da6eee8a7d tempest-VolumeImageDependencyTests-923660300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-74ff382a-1ba5-4fdf-9051-d8da6eee8a7d tempest-VolumeImageDependencyTests-923660300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-74ff382a-1ba5-4fdf-9051-d8da6eee8a7d tempest-VolumeImageDependencyTests-923660300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-74ff382a-1ba5-4fdf-9051-d8da6eee8a7d tempest-VolumeImageDependencyTests-923660300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-74ff382a-1ba5-4fdf-9051-d8da6eee8a7d tempest-VolumeImageDependencyTests-923660300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-74ff382a-1ba5-4fdf-9051-d8da6eee8a7d tempest-VolumeImageDependencyTests-923660300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:50 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:52:50 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:52:51 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 08 14:52:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-74ff382a-1ba5-4fdf-9051-d8da6eee8a7d tempest-VolumeImageDependencyTests-923660300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.628s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:52:51 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-74ff382a-1ba5-4fdf-9051-d8da6eee8a7d tempest-VolumeImageDependencyTests-923660300 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:52:51 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-74ff382a-1ba5-4fdf-9051-d8da6eee8a7d tempest-VolumeImageDependencyTests-923660300 None] Deleted volume successfully. Jul 08 14:52:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-74ff382a-1ba5-4fdf-9051-d8da6eee8a7d tempest-VolumeImageDependencyTests-923660300 None] Lock "cinder-22716705-dd38-427f-aab8-04ba190c7199-delete_volume" released by "delete_volume" :: held 3.029s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:52:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:52:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:52:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:52:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:52:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:52:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:52:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:52:59 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:52:59 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:00 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.777s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:53:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:53:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:53:00 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=13,cinder:SELECT=9,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:53:01 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=16,cinder:UPDATE=12,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Flow 'volume_create_manager' (9ec5a965-f15d-4f28-bc54-8cba6d4c0d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2c007b-db00-4a9d-b4e1-f5116a083b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2c007b-db00-4a9d-b4e1-f5116a083b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-792619222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ffdef47-d751-4d8d-a867-95122860b582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7934f4218e37470090dee62c14584047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:04Z,use_quota=True,user_id='122df7aeaf504ccc9909bca7b1412956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b5ecb5-43b9-433c-a4ff-b8c7611d20a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37b5ecb5-43b9-433c-a4ff-b8c7611d20a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ae7a69-96fd-46e1-b0a4-c45279b3fd15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ae7a69-96fd-46e1-b0a4-c45279b3fd15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ffdef47-d751-4d8d-a867-95122860b582', 'volume_name': 'volume-9ffdef47-d751-4d8d-a867-95122860b582', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bbaadeb-499e-4042-8a6e-799d5d887f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bbaadeb-499e-4042-8a6e-799d5d887f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2a61df-1a44-466f-aecf-e10672d78222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:04 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Volume 9ffdef47-d751-4d8d-a867-95122860b582: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ffdef47-d751-4d8d-a867-95122860b582', 'volume_size': 1} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-792619222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ffdef47-d751-4d8d-a867-95122860b582,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7934f4218e37470090dee62c14584047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:04Z,use_quota=True,user_id='122df7aeaf504ccc9909bca7b1412956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Creating volume 9ffdef47-d751-4d8d-a867-95122860b582 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:04 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:04 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582 1073741824 Jul 08 14:53:04 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Flow 'volume_create_manager' (220c7c43-8d96-4c47-92fb-96b3e7802c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7093133-73f5-4233-8746-7da7c2c6513c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7093133-73f5-4233-8746-7da7c2c6513c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-843741167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db8a65f-5ac7-43e3-98c3-1e1cf6310607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d12f782dd64bfbb30ea66fa0dbf378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:05Z,use_quota=True,user_id='d37b9d279483435987abe770faa83272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc518085-28ef-486a-bbd5-55199735f6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc518085-28ef-486a-bbd5-55199735f6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1f0b71-b695-4ae3-af66-8a17d5349b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1f0b71-b695-4ae3-af66-8a17d5349b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9db8a65f-5ac7-43e3-98c3-1e1cf6310607', 'volume_name': 'volume-9db8a65f-5ac7-43e3-98c3-1e1cf6310607', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a6b018-d83f-45b4-8170-770d0138099c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a6b018-d83f-45b4-8170-770d0138099c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebab5016-3f77-435f-a6d8-5abf25c30587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:04 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Volume 9db8a65f-5ac7-43e3-98c3-1e1cf6310607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9db8a65f-5ac7-43e3-98c3-1e1cf6310607', 'volume_size': 1} Jul 08 14:53:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:05 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582 1073741824" returned: 0 in 0.993s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:05 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582 Jul 08 14:53:05 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:06 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582" returned: 0 in 0.771s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.588s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-843741167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db8a65f-5ac7-43e3-98c3-1e1cf6310607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d12f782dd64bfbb30ea66fa0dbf378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:05Z,use_quota=True,user_id='d37b9d279483435987abe770faa83272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Creating volume 9db8a65f-5ac7-43e3-98c3-1e1cf6310607 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:06 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:53:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9db8a65f-5ac7-43e3-98c3-1e1cf6310607 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2a61df-1a44-466f-aecf-e10672d78222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ffdef47-d751-4d8d-a867-95122860b582', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:06 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9db8a65f-5ac7-43e3-98c3-1e1cf6310607 1073741824 Jul 08 14:53:06 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25eb5ad-62c9-4159-af19-6432674cd6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:06 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Volume volume-9ffdef47-d751-4d8d-a867-95122860b582 (9ffdef47-d751-4d8d-a867-95122860b582): created successfully Jul 08 14:53:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25eb5ad-62c9-4159-af19-6432674cd6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Flow 'volume_create_manager' (9ec5a965-f15d-4f28-bc54-8cba6d4c0d7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:06 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-577f2a8d-786e-4086-b1c1-21187fe7dcae tempest-VolumeDependencyTests-321806918 None] Created volume successfully. Jul 08 14:53:07 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:53:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Flow 'volume_create_manager' (0504741f-905d-4704-912d-451413182d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e26707b-d882-4480-be0c-f479e6f61fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e26707b-d882-4480-be0c-f479e6f61fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f26fce-df2b-4884-b828-9436bb5ac904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf7ca7fae694c598daccc2aab156b19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:07Z,use_quota=True,user_id='213b6db153ed47fa88c7495cc0b8ad87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6af3770-1ef2-499e-8c9c-23a8aa84c0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6af3770-1ef2-499e-8c9c-23a8aa84c0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc41cf84-cf54-4042-95f2-aebde5e87721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:07 devstack cinder-volume[87240]: DEBUG cinder.image.glance [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Creating Keystone auth plugin from conf {{(pid=87240) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 14:53:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc41cf84-cf54-4042-95f2-aebde5e87721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c7f26fce-df2b-4884-b828-9436bb5ac904', 'volume_name': 'volume-c7f26fce-df2b-4884-b828-9436bb5ac904', 'volume_size': 1, 'image_id': 'c1292db3-d073-4cd8-bb35-e61865d672b7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1292db3-d073-4cd8-bb35-e61865d672b7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51e42dfc1964c2d0fa023730bab0351c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fcf7ca7fae694c598daccc2aab156b19', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '69825b35137a6228c38820bcf5db7a07b820e95ff0964581a46f24abd5162ef9d7f3c147f09bc6f9a2eb8ff498e1f7456923637b8c92c5b7e53bcea9ff84960d', 'id': 'c1292db3-d073-4cd8-bb35-e61865d672b7', 'created_at': datetime.datetime(2026, 7, 8, 12, 53, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 53, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1292db3-d073-4cd8-bb35-e61865d672b7/file', 'properties': {}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c2fb58-852b-4c28-8def-866324d1d3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29c2fb58-852b-4c28-8def-866324d1d3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:07 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282f07d7-78f2-476f-879b-c9678123d6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:07 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Volume c7f26fce-df2b-4884-b828-9436bb5ac904: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c7f26fce-df2b-4884-b828-9436bb5ac904', 'volume_size': 1, 'image_id': 'c1292db3-d073-4cd8-bb35-e61865d672b7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1292db3-d073-4cd8-bb35-e61865d672b7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51e42dfc1964c2d0fa023730bab0351c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fcf7ca7fae694c598daccc2aab156b19', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '69825b35137a6228c38820bcf5db7a07b820e95ff0964581a46f24abd5162ef9d7f3c147f09bc6f9a2eb8ff498e1f7456923637b8c92c5b7e53bcea9ff84960d', 'id': 'c1292db3-d073-4cd8-bb35-e61865d672b7', 'created_at': datetime.datetime(2026, 7, 8, 12, 53, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 53, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1292db3-d073-4cd8-bb35-e61865d672b7/file', 'properties': {}}, 'image_service': } Jul 08 14:53:07 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Trying to clone c7f26fce-df2b-4884-b828-9436bb5ac904 from image c1292db3-d073-4cd8-bb35-e61865d672b7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c1292db3-d073-4cd8-bb35-e61865d672b7', 'metadata': {}}]). {{(pid=87240) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 14:53:07 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 14:53:07 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Image download 0.00 MB at 0.00 MB/s Jul 08 14:53:07 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef58eb55-5b4a-431f-87fb-60583b8da5bb]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:07 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9db8a65f-5ac7-43e3-98c3-1e1cf6310607 1073741824" returned: 0 in 1.209s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9db8a65f-5ac7-43e3-98c3-1e1cf6310607 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:07 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD Jul 08 14:53:07 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:07 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9db8a65f-5ac7-43e3-98c3-1e1cf6310607 Jul 08 14:53:07 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ae7b68e6-2458-4a02-9444-3230581caa55 tempest-VolumeDependencyTests-321806918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Flow 'volume_create_manager' (649edc48-9a1a-460e-8bcd-b06283416724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64df6cb8-2dbf-48a7-8047-dde073a4ac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64df6cb8-2dbf-48a7-8047-dde073a4ac51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4304db-9c7e-41ac-966d-e82c8bcb453b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be7e5d51c4cd4a95903f7505c9cccf3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:08Z,use_quota=True,user_id='65a470a85c4c4ac1a50a5acb744368b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8c8a1bd-da97-418b-933f-47de03537148),volume_type_id=a8c8a1bd-da97-418b-933f-47de03537148)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0adac0b5-cb9f-4405-87a0-d6da16bcc5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0adac0b5-cb9f-4405-87a0-d6da16bcc5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec34411-dc64-40b7-9c07-2add8b43ee1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG cinder.image.glance [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Creating Keystone auth plugin from conf {{(pid=87240) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec34411-dc64-40b7-9c07-2add8b43ee1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bc4304db-9c7e-41ac-966d-e82c8bcb453b', 'volume_name': 'volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b', 'volume_size': 1, 'image_id': 'ca134e96-93ea-4eea-ae92-39f58825f16f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca134e96-93ea-4eea-ae92-39f58825f16f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff979a86e5e38386c4e277005cc24127', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be7e5d51c4cd4a95903f7505c9cccf3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '479465f4da478c54c48a1ec532d6e09eb51a4492b4a5122c5acf68541ae13335b71e7fe0569746c2105aeacb705abe3e757ef94a3a6ab36bae927a9e428dca6e', 'id': 'ca134e96-93ea-4eea-ae92-39f58825f16f', 'created_at': datetime.datetime(2026, 7, 8, 12, 53, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 53, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca134e96-93ea-4eea-ae92-39f58825f16f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707a060e-52d0-4879-944f-0f70a79f7fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707a060e-52d0-4879-944f-0f70a79f7fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:08 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c36d679-0651-47c5-bda3-b46f9b8c4195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:08 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Volume bc4304db-9c7e-41ac-966d-e82c8bcb453b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b', 'volume_size': 1, 'image_id': 'ca134e96-93ea-4eea-ae92-39f58825f16f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca134e96-93ea-4eea-ae92-39f58825f16f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff979a86e5e38386c4e277005cc24127', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be7e5d51c4cd4a95903f7505c9cccf3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '479465f4da478c54c48a1ec532d6e09eb51a4492b4a5122c5acf68541ae13335b71e7fe0569746c2105aeacb705abe3e757ef94a3a6ab36bae927a9e428dca6e', 'id': 'ca134e96-93ea-4eea-ae92-39f58825f16f', 'created_at': datetime.datetime(2026, 7, 8, 12, 53, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 53, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca134e96-93ea-4eea-ae92-39f58825f16f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Trying to clone bc4304db-9c7e-41ac-966d-e82c8bcb453b from image ca134e96-93ea-4eea-ae92-39f58825f16f at location (None, [{'url': 'file:///opt/stack/data/glance/images/ca134e96-93ea-4eea-ae92-39f58825f16f', 'metadata': {}}]). {{(pid=87240) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 14:53:08 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD" returned: 0 in 0.897s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9db8a65f-5ac7-43e3-98c3-1e1cf6310607" returned: 0 in 0.777s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.073s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ae7b68e6-2458-4a02-9444-3230581caa55 tempest-VolumeDependencyTests-321806918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.703s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebab5016-3f77-435f-a6d8-5abf25c30587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9db8a65f-5ac7-43e3-98c3-1e1cf6310607', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8904926f-a64e-4aa7-b9ef-74c1ad132dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ae7b68e6-2458-4a02-9444-3230581caa55 tempest-VolumeDependencyTests-321806918 None] Creating offline snapshot 9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99 of volume 9ffdef47-d751-4d8d-a867-95122860b582 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:53:08 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Volume volume-9db8a65f-5ac7-43e3-98c3-1e1cf6310607 (9db8a65f-5ac7-43e3-98c3-1e1cf6310607): created successfully Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8904926f-a64e-4aa7-b9ef-74c1ad132dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Flow 'volume_create_manager' (220c7c43-8d96-4c47-92fb-96b3e7802c8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4278ea-1613-4ad8-9f39-87725d9959ce]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae7b68e6-2458-4a02-9444-3230581caa55 tempest-VolumeDependencyTests-321806918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 14:53:08 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Image download 0.00 MB at 0.00 MB/s Jul 08 14:53:08 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD Jul 08 14:53:08 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c0989e51-3847-49c3-95f0-1781c499962d tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Created volume successfully. Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb7dc61-f7bb-4967-9eb4-987fe776a182]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:08 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582 Jul 08 14:53:08 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:08 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD Jul 08 14:53:08 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:09 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD" returned: 1 in 0.806s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:53:09 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Temporary image c1292db3-d073-4cd8-bb35-e61865d672b7 is fetched for user 213b6db153ed47fa88c7495cc0b8ad87. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 14:53:09 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca8d3a8-40b3-4dd5-87ed-05e07f867a66]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:09 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae7b68e6-2458-4a02-9444-3230581caa55 tempest-VolumeDependencyTests-321806918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582" returned: 0 in 0.836s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae7b68e6-2458-4a02-9444-3230581caa55 tempest-VolumeDependencyTests-321806918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:09 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99 1G Jul 08 14:53:09 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:09 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD Jul 08 14:53:09 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:09 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD" returned: 0 in 0.874s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:09 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD Jul 08 14:53:09 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:10 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD" returned: 0 in 0.944s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:10 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:53:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Flow 'volume_create_manager' (a6462a60-79ab-45a9-abb9-b88d9f9ced3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e509106-3926-48ee-979d-09118d71ff20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e509106-3926-48ee-979d-09118d71ff20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-305499500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=116e82b0-b8a3-494c-91f2-d137bbe15fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d12f782dd64bfbb30ea66fa0dbf378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:10Z,use_quota=True,user_id='d37b9d279483435987abe770faa83272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa6c6af0-1704-4013-813e-0f99d06c7056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa6c6af0-1704-4013-813e-0f99d06c7056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78c96d87-c1bd-40de-b7e5-2d8f8ee973e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78c96d87-c1bd-40de-b7e5-2d8f8ee973e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '116e82b0-b8a3-494c-91f2-d137bbe15fba', 'volume_name': 'volume-116e82b0-b8a3-494c-91f2-d137bbe15fba', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3c2a60-4706-4a3f-afe9-5837d6d413db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f3c2a60-4706-4a3f-afe9-5837d6d413db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fdb2a53-08e7-4077-9050-56bfe696fc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:10 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Volume 116e82b0-b8a3-494c-91f2-d137bbe15fba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-116e82b0-b8a3-494c-91f2-d137bbe15fba', 'volume_size': 1} Jul 08 14:53:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:10 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD Jul 08 14:53:10 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:10 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD" returned: 1 in 0.979s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:53:10 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Temporary image ca134e96-93ea-4eea-ae92-39f58825f16f is fetched for user 65a470a85c4c4ac1a50a5acb744368b9. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 14:53:10 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae7b68e6-2458-4a02-9444-3230581caa55 tempest-VolumeDependencyTests-321806918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99 1G" returned: 0 in 1.127s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae7b68e6-2458-4a02-9444-3230581caa55 tempest-VolumeDependencyTests-321806918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ffdef47-d751-4d8d-a867-95122860b582 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:10 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ffdef47-d751-4d8d-a867-95122860b582 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99 Jul 08 14:53:10 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:10 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[65768b38-7d45-4692-a560-2f89e1e9cdb3]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:10 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD Jul 08 14:53:10 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Flow 'volume_create_manager' (c52cec78-776f-4f8d-8c95-5deefd3d4b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f769ecfa-9f81-40eb-bea1-cc3e68e0b04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f769ecfa-9f81-40eb-bea1-cc3e68e0b04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-762752634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042edca5-e226-4d1d-a017-ef26f659563e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d12f782dd64bfbb30ea66fa0dbf378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:11Z,use_quota=True,user_id='d37b9d279483435987abe770faa83272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7011a79-1041-415c-9e11-686506b2b567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7011a79-1041-415c-9e11-686506b2b567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9666b9fc-e614-4968-ab4c-a1d4af600c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9666b9fc-e614-4968-ab4c-a1d4af600c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '042edca5-e226-4d1d-a017-ef26f659563e', 'volume_name': 'volume-042edca5-e226-4d1d-a017-ef26f659563e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3fba033-bcbb-4900-8360-e3a7af78ea6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3fba033-bcbb-4900-8360-e3a7af78ea6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0817064c-21a3-4bb7-9c54-370efcb5e3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:11 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Volume 042edca5-e226-4d1d-a017-ef26f659563e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-042edca5-e226-4d1d-a017-ef26f659563e', 'volume_size': 1} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Flow 'volume_create_manager' (b9eefe83-8a26-46fc-b189-722ad1a4c951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d17842e-fe91-435a-bac3-10c92284a340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d17842e-fe91-435a-bac3-10c92284a340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-947642630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244d0c76-13ff-46ba-9b10-9192f5298931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d12f782dd64bfbb30ea66fa0dbf378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:11Z,use_quota=True,user_id='d37b9d279483435987abe770faa83272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (819b4e08-fc7b-4af1-b44c-26b137ba74d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (819b4e08-fc7b-4af1-b44c-26b137ba74d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170ed2d8-9d93-4f3b-907b-9aebde414702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170ed2d8-9d93-4f3b-907b-9aebde414702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '244d0c76-13ff-46ba-9b10-9192f5298931', 'volume_name': 'volume-244d0c76-13ff-46ba-9b10-9192f5298931', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b0d1d8d-4075-450a-905d-6fa923917c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b0d1d8d-4075-450a-905d-6fa923917c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ceca5b4-00fc-454d-a72c-3bc2dd6d7a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:11 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Volume 244d0c76-13ff-46ba-9b10-9192f5298931: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-244d0c76-13ff-46ba-9b10-9192f5298931', 'volume_size': 1} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:11 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD" returned: 1 in 1.203s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:11 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae7b68e6-2458-4a02-9444-3230581caa55 tempest-VolumeDependencyTests-321806918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ffdef47-d751-4d8d-a867-95122860b582 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99" returned: 0 in 1.020s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:11 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-ae7b68e6-2458-4a02-9444-3230581caa55 tempest-VolumeDependencyTests-321806918 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99 is being set with open permissions: ugo+rw Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae7b68e6-2458-4a02-9444-3230581caa55 tempest-VolumeDependencyTests-321806918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:11 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99 Jul 08 14:53:11 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:11 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD" returned: 0 in 1.069s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:12 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD Jul 08 14:53:12 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Flow 'volume_create_manager' (c51f3b6c-8cbc-49ec-ac8d-819c8976de11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (288f9983-ac99-4bbb-8523-11d14eb783ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (288f9983-ac99-4bbb-8523-11d14eb783ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1990125995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab171825-2c0d-47f4-bedc-5e14cad1d6aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d12f782dd64bfbb30ea66fa0dbf378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:12Z,use_quota=True,user_id='d37b9d279483435987abe770faa83272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa379a2-6ba1-4899-ac33-1ea541ae6d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa379a2-6ba1-4899-ac33-1ea541ae6d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8dc022-1325-4e09-bd2a-59294842d173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c8dc022-1325-4e09-bd2a-59294842d173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab171825-2c0d-47f4-bedc-5e14cad1d6aa', 'volume_name': 'volume-ab171825-2c0d-47f4-bedc-5e14cad1d6aa', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53d6342-2ffa-4f93-87bf-4c4baf25f894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c53d6342-2ffa-4f93-87bf-4c4baf25f894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584be979-07a5-4d7f-a67f-0cefe0e8e8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:12 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Volume ab171825-2c0d-47f4-bedc-5e14cad1d6aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab171825-2c0d-47f4-bedc-5e14cad1d6aa', 'volume_size': 1} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:53:12 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Flow 'volume_create_manager' (af753202-df1a-4607-b859-8d9bcc2239bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e49fc1-fcdc-4c15-8780-6c7a87f57ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae7b68e6-2458-4a02-9444-3230581caa55 tempest-VolumeDependencyTests-321806918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99" returned: 0 in 0.895s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8e49fc1-fcdc-4c15-8780-6c7a87f57ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1037866257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a5ed176-1e51-43e8-8886-56e9c6b7a934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d12f782dd64bfbb30ea66fa0dbf378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:13Z,use_quota=True,user_id='d37b9d279483435987abe770faa83272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (600a440b-803c-499d-826a-6868599a00d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (600a440b-803c-499d-826a-6868599a00d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6342534-0cbe-4e97-aad1-00d560451d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6342534-0cbe-4e97-aad1-00d560451d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a5ed176-1e51-43e8-8886-56e9c6b7a934', 'volume_name': 'volume-2a5ed176-1e51-43e8-8886-56e9c6b7a934', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c75a99f4-f8b6-4ea7-afb4-d8671327b1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c75a99f4-f8b6-4ea7-afb4-d8671327b1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b942527-a79c-4872-9460-c08ea8928a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:12 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Volume 2a5ed176-1e51-43e8-8886-56e9c6b7a934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a5ed176-1e51-43e8-8886-56e9c6b7a934', 'volume_size': 1} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae7b68e6-2458-4a02-9444-3230581caa55 tempest-VolumeDependencyTests-321806918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:12 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.info Jul 08 14:53:12 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:12 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD" returned: 1 in 0.885s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:53:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:13 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae7b68e6-2458-4a02-9444-3230581caa55 tempest-VolumeDependencyTests-321806918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.info" returned: 0 in 0.672s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:13 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-ae7b68e6-2458-4a02-9444-3230581caa55 tempest-VolumeDependencyTests-321806918 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.info is being set with open permissions: ugo+rw Jul 08 14:53:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae7b68e6-2458-4a02-9444-3230581caa55 tempest-VolumeDependencyTests-321806918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:13 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.info Jul 08 14:53:13 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:14 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae7b68e6-2458-4a02-9444-3230581caa55 tempest-VolumeDependencyTests-321806918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.info" returned: 0 in 0.633s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ae7b68e6-2458-4a02-9444-3230581caa55 tempest-VolumeDependencyTests-321806918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.368s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.434s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-305499500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=116e82b0-b8a3-494c-91f2-d137bbe15fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d12f782dd64bfbb30ea66fa0dbf378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:10Z,use_quota=True,user_id='d37b9d279483435987abe770faa83272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Creating volume 116e82b0-b8a3-494c-91f2-d137bbe15fba {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:14 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:53:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-116e82b0-b8a3-494c-91f2-d137bbe15fba 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:14 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-116e82b0-b8a3-494c-91f2-d137bbe15fba 1073741824 Jul 08 14:53:14 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:14 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ae7b68e6-2458-4a02-9444-3230581caa55 tempest-VolumeDependencyTests-321806918 None] Create snapshot completed successfully Jul 08 14:53:14 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-116e82b0-b8a3-494c-91f2-d137bbe15fba 1073741824" returned: 0 in 0.887s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:14 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:53:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Flow 'volume_create_manager' (a22008c6-c4a8-4c86-bfba-e9e3a61b3a5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93444ab7-b065-4772-a0d5-7cbdeaa9a70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-116e82b0-b8a3-494c-91f2-d137bbe15fba {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93444ab7-b065-4772-a0d5-7cbdeaa9a70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2098108390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42a1b084-bed1-40ae-861a-12d9933ab894,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7934f4218e37470090dee62c14584047',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:15Z,use_quota=True,user_id='122df7aeaf504ccc9909bca7b1412956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:15 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-116e82b0-b8a3-494c-91f2-d137bbe15fba Jul 08 14:53:15 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb80096-5578-4df3-a0e4-15c04d5ec301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eb80096-5578-4df3-a0e4-15c04d5ec301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858defda-d81a-4f55-a0c0-94f089ba664f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (858defda-d81a-4f55-a0c0-94f089ba664f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '42a1b084-bed1-40ae-861a-12d9933ab894', 'volume_name': 'volume-42a1b084-bed1-40ae-861a-12d9933ab894', 'volume_size': 1, 'snapshot_id': '9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b808b832-bfac-4583-81d6-cdd08a2f6d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b808b832-bfac-4583-81d6-cdd08a2f6d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec41268-70fa-44ba-a045-b0f3a453f9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:15 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Volume 42a1b084-bed1-40ae-861a-12d9933ab894: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-42a1b084-bed1-40ae-861a-12d9933ab894', 'volume_size': 1, 'snapshot_id': '9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99'} Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:15 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-116e82b0-b8a3-494c-91f2-d137bbe15fba" returned: 0 in 0.631s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.334s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-762752634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042edca5-e226-4d1d-a017-ef26f659563e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d12f782dd64bfbb30ea66fa0dbf378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:11Z,use_quota=True,user_id='d37b9d279483435987abe770faa83272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Creating volume 042edca5-e226-4d1d-a017-ef26f659563e {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:15 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042edca5-e226-4d1d-a017-ef26f659563e 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:15 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042edca5-e226-4d1d-a017-ef26f659563e 1073741824 Jul 08 14:53:15 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fdb2a53-08e7-4077-9050-56bfe696fc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-116e82b0-b8a3-494c-91f2-d137bbe15fba', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2c448f-02d2-4379-9a13-7bfcc57fc32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:15 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Volume volume-116e82b0-b8a3-494c-91f2-d137bbe15fba (116e82b0-b8a3-494c-91f2-d137bbe15fba): created successfully Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca2c448f-02d2-4379-9a13-7bfcc57fc32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Flow 'volume_create_manager' (a6462a60-79ab-45a9-abb9-b88d9f9ced3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:15 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2b033d07-d96f-4b71-a060-244fdfa12761 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Created volume successfully. Jul 08 14:53:16 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042edca5-e226-4d1d-a017-ef26f659563e 1073741824" returned: 0 in 0.827s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042edca5-e226-4d1d-a017-ef26f659563e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:16 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042edca5-e226-4d1d-a017-ef26f659563e Jul 08 14:53:16 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:17 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042edca5-e226-4d1d-a017-ef26f659563e" returned: 0 in 0.640s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] <== create_volume: return (1511ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.530s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-947642630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=244d0c76-13ff-46ba-9b10-9192f5298931,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d12f782dd64bfbb30ea66fa0dbf378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:11Z,use_quota=True,user_id='d37b9d279483435987abe770faa83272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Creating volume 244d0c76-13ff-46ba-9b10-9192f5298931 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:17 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:53:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-244d0c76-13ff-46ba-9b10-9192f5298931 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:17 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-244d0c76-13ff-46ba-9b10-9192f5298931 1073741824 Jul 08 14:53:17 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0817064c-21a3-4bb7-9c54-370efcb5e3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-042edca5-e226-4d1d-a017-ef26f659563e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01461c13-c71f-405c-8469-179b18d3d3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:17 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Volume volume-042edca5-e226-4d1d-a017-ef26f659563e (042edca5-e226-4d1d-a017-ef26f659563e): created successfully Jul 08 14:53:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01461c13-c71f-405c-8469-179b18d3d3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:17 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Flow 'volume_create_manager' (c52cec78-776f-4f8d-8c95-5deefd3d4b66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:17 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-adabed19-9025-4892-b473-0aa3d9fccb52 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Created volume successfully. Jul 08 14:53:17 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-244d0c76-13ff-46ba-9b10-9192f5298931 1073741824" returned: 0 in 0.836s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-244d0c76-13ff-46ba-9b10-9192f5298931 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:18 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-244d0c76-13ff-46ba-9b10-9192f5298931 Jul 08 14:53:18 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:18 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-244d0c76-13ff-46ba-9b10-9192f5298931" returned: 0 in 0.709s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.073s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7f26fce-df2b-4884-b828-9436bb5ac904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcf7ca7fae694c598daccc2aab156b19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:07Z,use_quota=True,user_id='213b6db153ed47fa88c7495cc0b8ad87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Creating volume c7f26fce-df2b-4884-b828-9436bb5ac904 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:18 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:53:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ceca5b4-00fc-454d-a72c-3bc2dd6d7a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-244d0c76-13ff-46ba-9b10-9192f5298931', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:18 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904 1073741824 Jul 08 14:53:18 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b33191c-2088-417d-8e83-d3bca470408d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:18 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Volume volume-244d0c76-13ff-46ba-9b10-9192f5298931 (244d0c76-13ff-46ba-9b10-9192f5298931): created successfully Jul 08 14:53:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b33191c-2088-417d-8e83-d3bca470408d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Flow 'volume_create_manager' (b9eefe83-8a26-46fc-b189-722ad1a4c951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:18 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9a870405-6478-45e6-985f-49dcc9fad78f tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Created volume successfully. Jul 08 14:53:19 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904 1073741824" returned: 0 in 0.919s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:19 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904 Jul 08 14:53:19 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:20 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904" returned: 0 in 0.713s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.153s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1990125995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab171825-2c0d-47f4-bedc-5e14cad1d6aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d12f782dd64bfbb30ea66fa0dbf378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:12Z,use_quota=True,user_id='d37b9d279483435987abe770faa83272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Creating volume ab171825-2c0d-47f4-bedc-5e14cad1d6aa {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:20 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:53:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab171825-2c0d-47f4-bedc-5e14cad1d6aa 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:20 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab171825-2c0d-47f4-bedc-5e14cad1d6aa 1073741824 Jul 08 14:53:20 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:20 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Attempting download of c1292db3-d073-4cd8-bb35-e61865d672b7 ((None, [{'url': 'file:///opt/stack/data/glance/images/c1292db3-d073-4cd8-bb35-e61865d672b7', 'metadata': {}}])) to volume c7f26fce-df2b-4884-b828-9436bb5ac904. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 14:53:20 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[395ebe3e-769c-4022-bbd1-91f2bdabc214]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1292db3-d073-4cd8-bb35-e61865d672b7_qq5rv_d3 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:20 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1292db3-d073-4cd8-bb35-e61865d672b7_qq5rv_d3 Jul 08 14:53:20 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:21 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c1292db3-d073-4cd8-bb35-e61865d672b7_qq5rv_d3" returned: 0 in 0.786s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1292db3-d073-4cd8-bb35-e61865d672b7_qq5rv_d3 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:21 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab171825-2c0d-47f4-bedc-5e14cad1d6aa 1073741824" returned: 0 in 0.933s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab171825-2c0d-47f4-bedc-5e14cad1d6aa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:21 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1292db3-d073-4cd8-bb35-e61865d672b7_qq5rv_d3 Jul 08 14:53:21 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:21 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab171825-2c0d-47f4-bedc-5e14cad1d6aa Jul 08 14:53:21 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:22 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1292db3-d073-4cd8-bb35-e61865d672b7_qq5rv_d3" returned: 1 in 0.728s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c1292db3-d073-4cd8-bb35-e61865d672b7_qq5rv_d3' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:53:22 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de0736f-3c16-434f-ae99-5dca932ebca2]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:22 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab171825-2c0d-47f4-bedc-5e14cad1d6aa" returned: 0 in 0.674s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.413s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1037866257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a5ed176-1e51-43e8-8886-56e9c6b7a934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79d12f782dd64bfbb30ea66fa0dbf378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:13Z,use_quota=True,user_id='d37b9d279483435987abe770faa83272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Creating volume 2a5ed176-1e51-43e8-8886-56e9c6b7a934 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:22 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:53:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2a5ed176-1e51-43e8-8886-56e9c6b7a934 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:22 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2a5ed176-1e51-43e8-8886-56e9c6b7a934 1073741824 Jul 08 14:53:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584be979-07a5-4d7f-a67f-0cefe0e8e8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab171825-2c0d-47f4-bedc-5e14cad1d6aa', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:22 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bc6fb89-9b90-4d56-8116-ab0c3894e99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:22 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Volume volume-ab171825-2c0d-47f4-bedc-5e14cad1d6aa (ab171825-2c0d-47f4-bedc-5e14cad1d6aa): created successfully Jul 08 14:53:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bc6fb89-9b90-4d56-8116-ab0c3894e99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Flow 'volume_create_manager' (c51f3b6c-8cbc-49ec-ac8d-819c8976de11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:22 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD Jul 08 14:53:22 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:22 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9295e40c-958b-4b78-a9ca-818221ff84ba tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Created volume successfully. Jul 08 14:53:22 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD" returned: 0 in 0.770s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:22 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD Jul 08 14:53:22 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:23 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2a5ed176-1e51-43e8-8886-56e9c6b7a934 1073741824" returned: 0 in 0.931s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2a5ed176-1e51-43e8-8886-56e9c6b7a934 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:23 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2a5ed176-1e51-43e8-8886-56e9c6b7a934 Jul 08 14:53:23 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:23 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD" returned: 1 in 0.793s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:53:23 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] c1292db3-d073-4cd8-bb35-e61865d672b7 was raw, converting to raw {{(pid=87240) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 14:53:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:23 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904 Jul 08 14:53:23 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:23 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2a5ed176-1e51-43e8-8886-56e9c6b7a934" returned: 0 in 0.697s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.990s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc4304db-9c7e-41ac-966d-e82c8bcb453b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be7e5d51c4cd4a95903f7505c9cccf3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:08Z,use_quota=True,user_id='65a470a85c4c4ac1a50a5acb744368b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a8c8a1bd-da97-418b-933f-47de03537148),volume_type_id=a8c8a1bd-da97-418b-933f-47de03537148)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Creating volume bc4304db-9c7e-41ac-966d-e82c8bcb453b {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:23 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:53:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:23 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b 1073741824 Jul 08 14:53:23 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b942527-a79c-4872-9460-c08ea8928a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a5ed176-1e51-43e8-8886-56e9c6b7a934', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b59eae46-5425-47a4-9bfe-8c86370da06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:23 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Volume volume-2a5ed176-1e51-43e8-8886-56e9c6b7a934 (2a5ed176-1e51-43e8-8886-56e9c6b7a934): created successfully Jul 08 14:53:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b59eae46-5425-47a4-9bfe-8c86370da06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Flow 'volume_create_manager' (af753202-df1a-4607-b859-8d9bcc2239bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:23 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-65a32fde-ce72-45e6-8cb6-b74c98253749 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Created volume successfully. Jul 08 14:53:24 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904" returned: 0 in 0.823s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:24 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c1292db3-d073-4cd8-bb35-e61865d672b7_k8w_j25pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:53:24 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 14:53:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:24 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904 1G Jul 08 14:53:24 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9777bb0a-59ac-4c77-b245-83b4f4fe1228 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "cinder-2a5ed176-1e51-43e8-8886-56e9c6b7a934-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9777bb0a-59ac-4c77-b245-83b4f4fe1228 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-2a5ed176-1e51-43e8-8886-56e9c6b7a934-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9777bb0a-59ac-4c77-b245-83b4f4fe1228 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "cinder-quobyte-2a5ed176-1e51-43e8-8886-56e9c6b7a934" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9777bb0a-59ac-4c77-b245-83b4f4fe1228 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-quobyte-2a5ed176-1e51-43e8-8886-56e9c6b7a934" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:24 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[62affb3e-d9fc-4818-964e-f8138d62589a]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9777bb0a-59ac-4c77-b245-83b4f4fe1228 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2a5ed176-1e51-43e8-8886-56e9c6b7a934 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:24 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b 1073741824" returned: 0 in 0.958s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:24 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2a5ed176-1e51-43e8-8886-56e9c6b7a934 Jul 08 14:53:24 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:24 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b Jul 08 14:53:24 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:25 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904 1G" returned: 0 in 0.796s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ece0e9-f146-4c3e-9ea2-df187c1d8c1a]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:25 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904 Jul 08 14:53:25 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:25 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b" returned: 0 in 0.710s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 10.445s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Acquiring lock "cinder-quobyte-9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99-42a1b084-bed1-40ae-861a-12d9933ab894" by "_create_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:25 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Lock "cinder-quobyte-9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99-42a1b084-bed1-40ae-861a-12d9933ab894" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Creating volume 42a1b084-bed1-40ae-861a-12d9933ab894 from snapshot 9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99 {{(pid=87240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Acquiring lock "cinder-quobyte-42a1b084-bed1-40ae-861a-12d9933ab894" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Attempting download of ca134e96-93ea-4eea-ae92-39f58825f16f ((None, [{'url': 'file:///opt/stack/data/glance/images/ca134e96-93ea-4eea-ae92-39f58825f16f', 'metadata': {}}])) to volume bc4304db-9c7e-41ac-966d-e82c8bcb453b. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9777bb0a-59ac-4c77-b245-83b4f4fe1228 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2a5ed176-1e51-43e8-8886-56e9c6b7a934" returned: 0 in 0.914s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9777bb0a-59ac-4c77-b245-83b4f4fe1228 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2a5ed176-1e51-43e8-8886-56e9c6b7a934 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Lock "cinder-quobyte-42a1b084-bed1-40ae-861a-12d9933ab894" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] snapshot: 9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99, volume: 42a1b084-bed1-40ae-861a-12d9933ab894, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:53:25 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2a5ed176-1e51-43e8-8886-56e9c6b7a934 Jul 08 14:53:25 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[804d53fa-dfbb-4ad1-880e-53c6c71add1a]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca134e96-93ea-4eea-ae92-39f58825f16f_jeaar_wh {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf8b17b-407d-4a19-9142-c30d0014b6cd]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:25 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca134e96-93ea-4eea-ae92-39f58825f16f_jeaar_wh Jul 08 14:53:25 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:25 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99 Jul 08 14:53:25 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:26 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904" returned: 0 in 0.979s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:26 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9777bb0a-59ac-4c77-b245-83b4f4fe1228 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-2a5ed176-1e51-43e8-8886-56e9c6b7a934" returned: 0 in 0.725s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9777bb0a-59ac-4c77-b245-83b4f4fe1228 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-quobyte-2a5ed176-1e51-43e8-8886-56e9c6b7a934" released by "delete_volume" :: held 1.706s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:26 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904 Jul 08 14:53:26 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:26 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-9777bb0a-59ac-4c77-b245-83b4f4fe1228 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Created reservations ['3e6ba957-3e95-4efb-92b1-1ee07f3c014f', 'ce8a3801-8f64-4751-bf2f-2896eaf5ec4c', '8c87615e-2fde-45de-9cc9-58be4bfe7029', '27622885-590c-4eae-8b6d-1ad63d1c8829'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:26 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca134e96-93ea-4eea-ae92-39f58825f16f_jeaar_wh" returned: 0 in 0.864s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca134e96-93ea-4eea-ae92-39f58825f16f_jeaar_wh {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9777bb0a-59ac-4c77-b245-83b4f4fe1228 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9777bb0a-59ac-4c77-b245-83b4f4fe1228 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9777bb0a-59ac-4c77-b245-83b4f4fe1228 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9777bb0a-59ac-4c77-b245-83b4f4fe1228 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9777bb0a-59ac-4c77-b245-83b4f4fe1228 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9777bb0a-59ac-4c77-b245-83b4f4fe1228 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:26 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:53:26 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:26 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99" returned: 0 in 0.929s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ffdef47-d751-4d8d-a867-95122860b582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:53:26 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca134e96-93ea-4eea-ae92-39f58825f16f_jeaar_wh Jul 08 14:53:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582 {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:53:26 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:53:26 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6104ef06-1d3b-4f77-8e83-a947281dcda3]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:26 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582 Jul 08 14:53:26 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-22d61373-2928-43dc-b4b7-ba4d0ae8a538 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "cinder-ab171825-2c0d-47f4-bedc-5e14cad1d6aa-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-22d61373-2928-43dc-b4b7-ba4d0ae8a538 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-ab171825-2c0d-47f4-bedc-5e14cad1d6aa-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-22d61373-2928-43dc-b4b7-ba4d0ae8a538 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "cinder-quobyte-ab171825-2c0d-47f4-bedc-5e14cad1d6aa" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-22d61373-2928-43dc-b4b7-ba4d0ae8a538 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-quobyte-ab171825-2c0d-47f4-bedc-5e14cad1d6aa" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[16974588-5857-4de8-ae5c-39f8586948b3]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22d61373-2928-43dc-b4b7-ba4d0ae8a538 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab171825-2c0d-47f4-bedc-5e14cad1d6aa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:27 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab171825-2c0d-47f4-bedc-5e14cad1d6aa Jul 08 14:53:27 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:27 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904" returned: 1 in 1.162s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Downloaded image c1292db3-d073-4cd8-bb35-e61865d672b7 ((None, [{'url': 'file:///opt/stack/data/glance/images/c1292db3-d073-4cd8-bb35-e61865d672b7', 'metadata': {}}])) to volume c7f26fce-df2b-4884-b828-9436bb5ac904 successfully. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Temporary image c1292db3-d073-4cd8-bb35-e61865d672b7 for user 213b6db153ed47fa88c7495cc0b8ad87 is deleted. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Marking volume c7f26fce-df2b-4884-b828-9436bb5ac904 as bootable. {{(pid=87240) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Copying metadata from image c1292db3-d073-4cd8-bb35-e61865d672b7 to c7f26fce-df2b-4884-b828-9436bb5ac904. {{(pid=87240) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Creating volume glance metadata for volume c7f26fce-df2b-4884-b828-9436bb5ac904 backed by image c1292db3-d073-4cd8-bb35-e61865d672b7 with: {'image_id': 'c1292db3-d073-4cd8-bb35-e61865d672b7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '51e42dfc1964c2d0fa023730bab0351c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87240) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 14:53:27 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9777bb0a-59ac-4c77-b245-83b4f4fe1228 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.945s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-9777bb0a-59ac-4c77-b245-83b4f4fe1228 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:27 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9777bb0a-59ac-4c77-b245-83b4f4fe1228 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Deleted volume successfully. Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9777bb0a-59ac-4c77-b245-83b4f4fe1228 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-2a5ed176-1e51-43e8-8886-56e9c6b7a934-delete_volume" released by "delete_volume" :: held 3.026s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282f07d7-78f2-476f-879b-c9678123d6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7f26fce-df2b-4884-b828-9436bb5ac904', 'volume_size': 1, 'image_id': 'c1292db3-d073-4cd8-bb35-e61865d672b7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c1292db3-d073-4cd8-bb35-e61865d672b7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '51e42dfc1964c2d0fa023730bab0351c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fcf7ca7fae694c598daccc2aab156b19', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '69825b35137a6228c38820bcf5db7a07b820e95ff0964581a46f24abd5162ef9d7f3c147f09bc6f9a2eb8ff498e1f7456923637b8c92c5b7e53bcea9ff84960d', 'id': 'c1292db3-d073-4cd8-bb35-e61865d672b7', 'created_at': datetime.datetime(2026, 7, 8, 12, 53, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 53, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c1292db3-d073-4cd8-bb35-e61865d672b7/file', 'properties': {}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ecfa6b-c2fe-4d86-abd2-354b826db4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:27 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Volume volume-c7f26fce-df2b-4884-b828-9436bb5ac904 (c7f26fce-df2b-4884-b828-9436bb5ac904): created successfully Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9ecfa6b-c2fe-4d86-abd2-354b826db4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Flow 'volume_create_manager' (0504741f-905d-4704-912d-451413182d58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:27 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a93ffac4-2c33-4177-8ad9-c29a89aa2b1a tempest-VolumeImageDependencyTests-912281223 None] Created volume successfully. Jul 08 14:53:27 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca134e96-93ea-4eea-ae92-39f58825f16f_jeaar_wh" returned: 1 in 1.245s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca134e96-93ea-4eea-ae92-39f58825f16f_jeaar_wh' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a21de5-fc11-41ff-949f-dfebea5fde41]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:27 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582" returned: 0 in 1.153s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Path /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-42a1b084-bed1-40ae-861a-12d9933ab894 not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-42a1b084-bed1-40ae-861a-12d9933ab894 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:27 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-42a1b084-bed1-40ae-861a-12d9933ab894 Jul 08 14:53:27 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:27 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD Jul 08 14:53:27 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:27 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22d61373-2928-43dc-b4b7-ba4d0ae8a538 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab171825-2c0d-47f4-bedc-5e14cad1d6aa" returned: 0 in 0.962s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22d61373-2928-43dc-b4b7-ba4d0ae8a538 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab171825-2c0d-47f4-bedc-5e14cad1d6aa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:28 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab171825-2c0d-47f4-bedc-5e14cad1d6aa Jul 08 14:53:28 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:28 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD" returned: 0 in 0.837s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:28 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD Jul 08 14:53:28 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:29 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22d61373-2928-43dc-b4b7-ba4d0ae8a538 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ab171825-2c0d-47f4-bedc-5e14cad1d6aa" returned: 0 in 1.090s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-22d61373-2928-43dc-b4b7-ba4d0ae8a538 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-quobyte-ab171825-2c0d-47f4-bedc-5e14cad1d6aa" released by "delete_volume" :: held 2.128s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4b0d2e07-8e7a-402c-ba6b-f09f9746e9f9 tempest-VolumeImageDependencyTests-912281223 None] Acquiring lock "cinder-c7f26fce-df2b-4884-b828-9436bb5ac904-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:29 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-22d61373-2928-43dc-b4b7-ba4d0ae8a538 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Created reservations ['6488db24-b11a-4e59-bb57-e55ee44f2f5e', '82a27e92-464a-46f5-ba81-f35db256945b', '8785675b-c8af-4e28-ad52-adcf9a50d76a', 'c20f109e-59eb-4ee2-94cd-8cc03ffab5cb'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4b0d2e07-8e7a-402c-ba6b-f09f9746e9f9 tempest-VolumeImageDependencyTests-912281223 None] Lock "cinder-c7f26fce-df2b-4884-b828-9436bb5ac904-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4b0d2e07-8e7a-402c-ba6b-f09f9746e9f9 tempest-VolumeImageDependencyTests-912281223 None] Acquiring lock "cinder-quobyte-c7f26fce-df2b-4884-b828-9436bb5ac904" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4b0d2e07-8e7a-402c-ba6b-f09f9746e9f9 tempest-VolumeImageDependencyTests-912281223 None] Lock "cinder-quobyte-c7f26fce-df2b-4884-b828-9436bb5ac904" acquired by "delete_volume" :: waited 0.061s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:29 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[945d4f60-5fbf-4ace-9980-eae40b726f85]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4b0d2e07-8e7a-402c-ba6b-f09f9746e9f9 tempest-VolumeImageDependencyTests-912281223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-22d61373-2928-43dc-b4b7-ba4d0ae8a538 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-22d61373-2928-43dc-b4b7-ba4d0ae8a538 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-22d61373-2928-43dc-b4b7-ba4d0ae8a538 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-22d61373-2928-43dc-b4b7-ba4d0ae8a538 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-22d61373-2928-43dc-b4b7-ba4d0ae8a538 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22d61373-2928-43dc-b4b7-ba4d0ae8a538 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:29 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:53:29 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:30 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904 Jul 08 14:53:30 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:30 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-56c2ece0-5cdc-445e-96c9-e9b4f3f30a4e tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "cinder-244d0c76-13ff-46ba-9b10-9192f5298931-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:30 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-56c2ece0-5cdc-445e-96c9-e9b4f3f30a4e tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-244d0c76-13ff-46ba-9b10-9192f5298931-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:30 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-56c2ece0-5cdc-445e-96c9-e9b4f3f30a4e tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "cinder-quobyte-244d0c76-13ff-46ba-9b10-9192f5298931" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:30 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-56c2ece0-5cdc-445e-96c9-e9b4f3f30a4e tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-quobyte-244d0c76-13ff-46ba-9b10-9192f5298931" acquired by "delete_volume" :: waited 0.036s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:30 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d6764f-23ec-4a94-a022-f7b44d537c90]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-56c2ece0-5cdc-445e-96c9-e9b4f3f30a4e tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-244d0c76-13ff-46ba-9b10-9192f5298931 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:30 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD" returned: 1 in 2.408s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:53:31 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] ca134e96-93ea-4eea-ae92-39f58825f16f was raw, converting to raw {{(pid=87240) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 14:53:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:31 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b Jul 08 14:53:31 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:31 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-244d0c76-13ff-46ba-9b10-9192f5298931 Jul 08 14:53:31 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:31 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-22d61373-2928-43dc-b4b7-ba4d0ae8a538 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.761s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:31 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-22d61373-2928-43dc-b4b7-ba4d0ae8a538 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:31 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-22d61373-2928-43dc-b4b7-ba4d0ae8a538 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Deleted volume successfully. Jul 08 14:53:31 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-22d61373-2928-43dc-b4b7-ba4d0ae8a538 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-ab171825-2c0d-47f4-bedc-5e14cad1d6aa-delete_volume" released by "delete_volume" :: held 4.723s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:32 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4b0d2e07-8e7a-402c-ba6b-f09f9746e9f9 tempest-VolumeImageDependencyTests-912281223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904" returned: 0 in 2.347s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4b0d2e07-8e7a-402c-ba6b-f09f9746e9f9 tempest-VolumeImageDependencyTests-912281223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:32 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904 Jul 08 14:53:32 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:33 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b" returned: 0 in 2.212s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:33 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ca134e96-93ea-4eea-ae92-39f58825f16f_2dbw7uyddevstack@QuobyteHD, size 0.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:53:33 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 14:53:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:33 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b 1G Jul 08 14:53:33 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:33 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-56c2ece0-5cdc-445e-96c9-e9b4f3f30a4e tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-244d0c76-13ff-46ba-9b10-9192f5298931" returned: 0 in 2.608s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-56c2ece0-5cdc-445e-96c9-e9b4f3f30a4e tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-244d0c76-13ff-46ba-9b10-9192f5298931 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:33 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-244d0c76-13ff-46ba-9b10-9192f5298931 Jul 08 14:53:33 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:34 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-42a1b084-bed1-40ae-861a-12d9933ab894" returned: 0 in 6.291s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:34 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f3541d-0e86-4cb2-aaf3-3821c1ac4064]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:34 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582 Jul 08 14:53:34 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:34 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4b0d2e07-8e7a-402c-ba6b-f09f9746e9f9 tempest-VolumeImageDependencyTests-912281223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904" returned: 1 in 2.251s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4b0d2e07-8e7a-402c-ba6b-f09f9746e9f9 tempest-VolumeImageDependencyTests-912281223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:53:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4b0d2e07-8e7a-402c-ba6b-f09f9746e9f9 tempest-VolumeImageDependencyTests-912281223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:34 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904 Jul 08 14:53:34 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:34 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b 1G" returned: 0 in 1.233s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:34 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[87443285-c428-4f87-8ac7-e5a38893df38]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:34 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b Jul 08 14:53:34 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:34 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-56c2ece0-5cdc-445e-96c9-e9b4f3f30a4e tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-244d0c76-13ff-46ba-9b10-9192f5298931" returned: 0 in 1.135s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-56c2ece0-5cdc-445e-96c9-e9b4f3f30a4e tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-quobyte-244d0c76-13ff-46ba-9b10-9192f5298931" released by "delete_volume" :: held 3.837s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:34 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-56c2ece0-5cdc-445e-96c9-e9b4f3f30a4e tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Created reservations ['9dd12790-904a-454d-a17c-6b390317f161', '9a28708a-02f9-4bc1-901e-cce2e9ccdac1', '959a86ec-f1a2-4c4f-be7b-9330629ca199', '04e68f31-a1c8-4fe2-a3ea-8ae9a31680cf'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-56c2ece0-5cdc-445e-96c9-e9b4f3f30a4e tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-56c2ece0-5cdc-445e-96c9-e9b4f3f30a4e tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-56c2ece0-5cdc-445e-96c9-e9b4f3f30a4e tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-56c2ece0-5cdc-445e-96c9-e9b4f3f30a4e tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-56c2ece0-5cdc-445e-96c9-e9b4f3f30a4e tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-56c2ece0-5cdc-445e-96c9-e9b4f3f30a4e tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:34 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:53:34 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:35 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4b0d2e07-8e7a-402c-ba6b-f09f9746e9f9 tempest-VolumeImageDependencyTests-912281223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c7f26fce-df2b-4884-b828-9436bb5ac904" returned: 0 in 0.787s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4b0d2e07-8e7a-402c-ba6b-f09f9746e9f9 tempest-VolumeImageDependencyTests-912281223 None] Lock "cinder-quobyte-c7f26fce-df2b-4884-b828-9436bb5ac904" released by "delete_volume" :: held 5.551s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:35 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582" returned: 0 in 1.043s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:35 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Image conversion details: src /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582, size 1024.00 MB, duration 6.29 sec, destination /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-42a1b084-bed1-40ae-861a-12d9933ab894 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:53:35 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Converted 1024.00 MB image at 162.73 MB/s Jul 08 14:53:35 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-42a1b084-bed1-40ae-861a-12d9933ab894 is being set with open permissions: ugo+rw Jul 08 14:53:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-42a1b084-bed1-40ae-861a-12d9933ab894 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:35 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-42a1b084-bed1-40ae-861a-12d9933ab894 Jul 08 14:53:35 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:35 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-4b0d2e07-8e7a-402c-ba6b-f09f9746e9f9 tempest-VolumeImageDependencyTests-912281223 None] Created reservations ['081e6e0e-d4ea-4df0-b2be-da3c61ec5995', '54d57265-5cf3-4d99-9469-ed107e59b317', '99fa08e9-5833-4871-93f1-18b01d05e2e3', 'fd95836d-3a14-484c-8321-61a3ae220ed4'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4b0d2e07-8e7a-402c-ba6b-f09f9746e9f9 tempest-VolumeImageDependencyTests-912281223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4b0d2e07-8e7a-402c-ba6b-f09f9746e9f9 tempest-VolumeImageDependencyTests-912281223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4b0d2e07-8e7a-402c-ba6b-f09f9746e9f9 tempest-VolumeImageDependencyTests-912281223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4b0d2e07-8e7a-402c-ba6b-f09f9746e9f9 tempest-VolumeImageDependencyTests-912281223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4b0d2e07-8e7a-402c-ba6b-f09f9746e9f9 tempest-VolumeImageDependencyTests-912281223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4b0d2e07-8e7a-402c-ba6b-f09f9746e9f9 tempest-VolumeImageDependencyTests-912281223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:35 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:53:35 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-49138543-2f6e-4b9b-ba3c-b35083bb22a0 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "cinder-042edca5-e226-4d1d-a017-ef26f659563e-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:35 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b" returned: 0 in 0.909s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-49138543-2f6e-4b9b-ba3c-b35083bb22a0 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-042edca5-e226-4d1d-a017-ef26f659563e-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-49138543-2f6e-4b9b-ba3c-b35083bb22a0 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "cinder-quobyte-042edca5-e226-4d1d-a017-ef26f659563e" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-49138543-2f6e-4b9b-ba3c-b35083bb22a0 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-quobyte-042edca5-e226-4d1d-a017-ef26f659563e" acquired by "delete_volume" :: waited 0.032s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:35 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fcfda4-eaf0-4726-80b3-853358e8e706]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-49138543-2f6e-4b9b-ba3c-b35083bb22a0 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042edca5-e226-4d1d-a017-ef26f659563e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:35 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b Jul 08 14:53:35 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:35 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-56c2ece0-5cdc-445e-96c9-e9b4f3f30a4e tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.804s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:35 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-56c2ece0-5cdc-445e-96c9-e9b4f3f30a4e tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:35 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-56c2ece0-5cdc-445e-96c9-e9b4f3f30a4e tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Deleted volume successfully. Jul 08 14:53:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-56c2ece0-5cdc-445e-96c9-e9b4f3f30a4e tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-244d0c76-13ff-46ba-9b10-9192f5298931-delete_volume" released by "delete_volume" :: held 5.054s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:35 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042edca5-e226-4d1d-a017-ef26f659563e Jul 08 14:53:35 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:36 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4b0d2e07-8e7a-402c-ba6b-f09f9746e9f9 tempest-VolumeImageDependencyTests-912281223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.781s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-4b0d2e07-8e7a-402c-ba6b-f09f9746e9f9 tempest-VolumeImageDependencyTests-912281223 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:36 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-42a1b084-bed1-40ae-861a-12d9933ab894" returned: 0 in 0.945s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:36 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4b0d2e07-8e7a-402c-ba6b-f09f9746e9f9 tempest-VolumeImageDependencyTests-912281223 None] Deleted volume successfully. Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Lock "cinder-quobyte-42a1b084-bed1-40ae-861a-12d9933ab894" released by "_copy_volume_from_snapshot" :: held 10.531s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Lock "cinder-quobyte-9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99-42a1b084-bed1-40ae-861a-12d9933ab894" released by "_create_volume_from_snapshot" :: held 10.591s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.628s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4b0d2e07-8e7a-402c-ba6b-f09f9746e9f9 tempest-VolumeImageDependencyTests-912281223 None] Lock "cinder-c7f26fce-df2b-4884-b828-9436bb5ac904-delete_volume" released by "delete_volume" :: held 6.809s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec41268-70fa-44ba-a045-b0f3a453f9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42a1b084-bed1-40ae-861a-12d9933ab894', 'volume_size': 1, 'snapshot_id': '9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ce1b6ec-b8cf-4a47-9e53-b228d026eedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:36 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Volume volume-42a1b084-bed1-40ae-861a-12d9933ab894 (42a1b084-bed1-40ae-861a-12d9933ab894): created successfully Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ce1b6ec-b8cf-4a47-9e53-b228d026eedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Flow 'volume_create_manager' (a22008c6-c4a8-4c86-bfba-e9e3a61b3a5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:36 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-19a6d092-cc74-42ae-bdcf-8277d54e9d02 tempest-VolumeDependencyTests-321806918 None] Created volume successfully. Jul 08 14:53:36 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-49138543-2f6e-4b9b-ba3c-b35083bb22a0 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042edca5-e226-4d1d-a017-ef26f659563e" returned: 0 in 0.865s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-49138543-2f6e-4b9b-ba3c-b35083bb22a0 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042edca5-e226-4d1d-a017-ef26f659563e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:36 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b" returned: 1 in 1.088s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Downloaded image ca134e96-93ea-4eea-ae92-39f58825f16f ((None, [{'url': 'file:///opt/stack/data/glance/images/ca134e96-93ea-4eea-ae92-39f58825f16f', 'metadata': {}}])) to volume bc4304db-9c7e-41ac-966d-e82c8bcb453b successfully. {{(pid=87240) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Temporary image ca134e96-93ea-4eea-ae92-39f58825f16f for user 65a470a85c4c4ac1a50a5acb744368b9 is deleted. {{(pid=87240) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG cinder.volume.volume_utils [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Marking volume bc4304db-9c7e-41ac-966d-e82c8bcb453b as bootable. {{(pid=87240) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 14:53:36 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042edca5-e226-4d1d-a017-ef26f659563e Jul 08 14:53:36 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Copying metadata from image ca134e96-93ea-4eea-ae92-39f58825f16f to bc4304db-9c7e-41ac-966d-e82c8bcb453b. {{(pid=87240) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Creating volume glance metadata for volume bc4304db-9c7e-41ac-966d-e82c8bcb453b backed by image ca134e96-93ea-4eea-ae92-39f58825f16f with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ca134e96-93ea-4eea-ae92-39f58825f16f', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ff979a86e5e38386c4e277005cc24127', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87240) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c36d679-0651-47c5-bda3-b46f9b8c4195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b', 'volume_size': 1, 'image_id': 'ca134e96-93ea-4eea-ae92-39f58825f16f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca134e96-93ea-4eea-ae92-39f58825f16f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff979a86e5e38386c4e277005cc24127', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be7e5d51c4cd4a95903f7505c9cccf3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '479465f4da478c54c48a1ec532d6e09eb51a4492b4a5122c5acf68541ae13335b71e7fe0569746c2105aeacb705abe3e757ef94a3a6ab36bae927a9e428dca6e', 'id': 'ca134e96-93ea-4eea-ae92-39f58825f16f', 'created_at': datetime.datetime(2026, 7, 8, 12, 53, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 8, 12, 53, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca134e96-93ea-4eea-ae92-39f58825f16f/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9efd57-395f-48d0-ac65-1b0ec5ace7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:36 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Volume volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b (bc4304db-9c7e-41ac-966d-e82c8bcb453b): created successfully Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a9efd57-395f-48d0-ac65-1b0ec5ace7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Flow 'volume_create_manager' (649edc48-9a1a-460e-8bcd-b06283416724) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:36 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-af38cc2f-2ed4-4ca2-b45a-32747791cba9 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Created volume successfully. Jul 08 14:53:36 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fdcfaf62-e1b7-4376-9f14-95bcfdc0da39 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Acquiring lock "cinder-bc4304db-9c7e-41ac-966d-e82c8bcb453b-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fdcfaf62-e1b7-4376-9f14-95bcfdc0da39 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Lock "cinder-bc4304db-9c7e-41ac-966d-e82c8bcb453b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fdcfaf62-e1b7-4376-9f14-95bcfdc0da39 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Acquiring lock "cinder-quobyte-bc4304db-9c7e-41ac-966d-e82c8bcb453b" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fdcfaf62-e1b7-4376-9f14-95bcfdc0da39 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Lock "cinder-quobyte-bc4304db-9c7e-41ac-966d-e82c8bcb453b" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff90ed8-5ff3-4dff-922b-86135fa37b39]: (4, 'raw') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdcfaf62-e1b7-4376-9f14-95bcfdc0da39 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-41b6a810-9f8a-4e8e-bfed-57457088db55 tempest-VolumeDependencyTests-321806918 None] Acquiring lock "cinder-9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-41b6a810-9f8a-4e8e-bfed-57457088db55 tempest-VolumeDependencyTests-321806918 None] Lock "cinder-9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-41b6a810-9f8a-4e8e-bfed-57457088db55 tempest-VolumeDependencyTests-321806918 None] Acquiring lock "cinder-quobyte-9ffdef47-d751-4d8d-a867-95122860b582" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-41b6a810-9f8a-4e8e-bfed-57457088db55 tempest-VolumeDependencyTests-321806918 None] Lock "cinder-quobyte-9ffdef47-d751-4d8d-a867-95122860b582" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-41b6a810-9f8a-4e8e-bfed-57457088db55 tempest-VolumeDependencyTests-321806918 None] Acquiring lock "cinder-quobyte-9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-41b6a810-9f8a-4e8e-bfed-57457088db55 tempest-VolumeDependencyTests-321806918 None] Lock "cinder-quobyte-9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-41b6a810-9f8a-4e8e-bfed-57457088db55 tempest-VolumeDependencyTests-321806918 None] Deleting offline snapshot 9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99 of volume 9ffdef47-d751-4d8d-a867-95122860b582 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-41b6a810-9f8a-4e8e-bfed-57457088db55 tempest-VolumeDependencyTests-321806918 None] snapshot_file for this snap is: volume-9ffdef47-d751-4d8d-a867-95122860b582.9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a13c62-7f89-4f0c-869f-3bc1c834df80]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-41b6a810-9f8a-4e8e-bfed-57457088db55 tempest-VolumeDependencyTests-321806918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:37 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b Jul 08 14:53:37 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:37 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-49138543-2f6e-4b9b-ba3c-b35083bb22a0 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042edca5-e226-4d1d-a017-ef26f659563e" returned: 0 in 0.854s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-49138543-2f6e-4b9b-ba3c-b35083bb22a0 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-quobyte-042edca5-e226-4d1d-a017-ef26f659563e" released by "delete_volume" :: held 1.797s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:37 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99 Jul 08 14:53:37 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-49138543-2f6e-4b9b-ba3c-b35083bb22a0 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Created reservations ['72c8fe49-fddf-443c-b174-694884c80b05', 'd45415a8-f6d6-4146-b17e-6e50150671a0', '3169f9e5-7013-4f7b-a440-fb9a9b863370', '1c67aa03-7d59-4a2c-95fb-5c154f398da0'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-49138543-2f6e-4b9b-ba3c-b35083bb22a0 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-49138543-2f6e-4b9b-ba3c-b35083bb22a0 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-49138543-2f6e-4b9b-ba3c-b35083bb22a0 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-49138543-2f6e-4b9b-ba3c-b35083bb22a0 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-49138543-2f6e-4b9b-ba3c-b35083bb22a0 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-49138543-2f6e-4b9b-ba3c-b35083bb22a0 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:37 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:53:37 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5ff35b90-2251-4fb4-baae-3d333582ca39 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "cinder-116e82b0-b8a3-494c-91f2-d137bbe15fba-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5ff35b90-2251-4fb4-baae-3d333582ca39 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-116e82b0-b8a3-494c-91f2-d137bbe15fba-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5ff35b90-2251-4fb4-baae-3d333582ca39 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "cinder-quobyte-116e82b0-b8a3-494c-91f2-d137bbe15fba" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5ff35b90-2251-4fb4-baae-3d333582ca39 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-quobyte-116e82b0-b8a3-494c-91f2-d137bbe15fba" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1852f68f-33a9-4153-92fb-9afcf589980e]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5ff35b90-2251-4fb4-baae-3d333582ca39 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-116e82b0-b8a3-494c-91f2-d137bbe15fba {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:38 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:38 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-116e82b0-b8a3-494c-91f2-d137bbe15fba Jul 08 14:53:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdcfaf62-e1b7-4376-9f14-95bcfdc0da39 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b" returned: 0 in 1.033s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdcfaf62-e1b7-4376-9f14-95bcfdc0da39 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:38 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:38 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b Jul 08 14:53:38 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:38 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-41b6a810-9f8a-4e8e-bfed-57457088db55 tempest-VolumeDependencyTests-321806918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99" returned: 0 in 1.307s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-41b6a810-9f8a-4e8e-bfed-57457088db55 tempest-VolumeDependencyTests-321806918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ffdef47-d751-4d8d-a867-95122860b582(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:53:38 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5ca026-f8b5-4078-a8e4-871a66b76757]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-41b6a810-9f8a-4e8e-bfed-57457088db55 tempest-VolumeDependencyTests-321806918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:38 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-49138543-2f6e-4b9b-ba3c-b35083bb22a0 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.141s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:38 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-49138543-2f6e-4b9b-ba3c-b35083bb22a0 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:38 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-49138543-2f6e-4b9b-ba3c-b35083bb22a0 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Deleted volume successfully. Jul 08 14:53:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-49138543-2f6e-4b9b-ba3c-b35083bb22a0 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-042edca5-e226-4d1d-a017-ef26f659563e-delete_volume" released by "delete_volume" :: held 3.303s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:38 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582 Jul 08 14:53:38 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:39 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5ff35b90-2251-4fb4-baae-3d333582ca39 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-116e82b0-b8a3-494c-91f2-d137bbe15fba" returned: 0 in 1.149s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5ff35b90-2251-4fb4-baae-3d333582ca39 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-116e82b0-b8a3-494c-91f2-d137bbe15fba {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:39 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-116e82b0-b8a3-494c-91f2-d137bbe15fba Jul 08 14:53:39 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:39 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdcfaf62-e1b7-4376-9f14-95bcfdc0da39 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b" returned: 1 in 1.040s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdcfaf62-e1b7-4376-9f14-95bcfdc0da39 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b' failed. Not Retrying. {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 14:53:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdcfaf62-e1b7-4376-9f14-95bcfdc0da39 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:39 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b Jul 08 14:53:39 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:39 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-41b6a810-9f8a-4e8e-bfed-57457088db55 tempest-VolumeDependencyTests-321806918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582" returned: 0 in 0.947s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-41b6a810-9f8a-4e8e-bfed-57457088db55 tempest-VolumeDependencyTests-321806918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:39 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99 Jul 08 14:53:39 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:39 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5ff35b90-2251-4fb4-baae-3d333582ca39 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-116e82b0-b8a3-494c-91f2-d137bbe15fba" returned: 0 in 0.764s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:39 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5ff35b90-2251-4fb4-baae-3d333582ca39 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-quobyte-116e82b0-b8a3-494c-91f2-d137bbe15fba" released by "delete_volume" :: held 1.988s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:39 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-5ff35b90-2251-4fb4-baae-3d333582ca39 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Created reservations ['d322b33a-036a-4f28-9dff-e7439cf153fe', '423371f5-69c2-4f2e-86b6-deee53a12672', '85f1a2ae-2d0d-4d7f-8bbc-acb9230e7539', '5fcfa67d-1341-4e9c-a92b-d6471435e4cf'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:40 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdcfaf62-e1b7-4376-9f14-95bcfdc0da39 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-bc4304db-9c7e-41ac-966d-e82c8bcb453b" returned: 0 in 0.833s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fdcfaf62-e1b7-4376-9f14-95bcfdc0da39 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Lock "cinder-quobyte-bc4304db-9c7e-41ac-966d-e82c8bcb453b" released by "delete_volume" :: held 3.011s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5ff35b90-2251-4fb4-baae-3d333582ca39 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5ff35b90-2251-4fb4-baae-3d333582ca39 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5ff35b90-2251-4fb4-baae-3d333582ca39 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5ff35b90-2251-4fb4-baae-3d333582ca39 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5ff35b90-2251-4fb4-baae-3d333582ca39 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5ff35b90-2251-4fb4-baae-3d333582ca39 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:40 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:53:40 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-09fd2d04-4779-4203-a907-08df1abcc8c2 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "cinder-9db8a65f-5ac7-43e3-98c3-1e1cf6310607-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:40 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-fdcfaf62-e1b7-4376-9f14-95bcfdc0da39 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Created reservations ['0b802e35-c2b2-49ac-be39-f249158fdabb', '8b158e8a-d366-4537-a701-5697a10a0392', '535d400b-cc33-4242-8334-2574a48c38bb', 'd90bd34d-b43d-40c8-afa4-d5c3348ef4b9'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-09fd2d04-4779-4203-a907-08df1abcc8c2 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-9db8a65f-5ac7-43e3-98c3-1e1cf6310607-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-09fd2d04-4779-4203-a907-08df1abcc8c2 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "cinder-quobyte-9db8a65f-5ac7-43e3-98c3-1e1cf6310607" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-09fd2d04-4779-4203-a907-08df1abcc8c2 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-quobyte-9db8a65f-5ac7-43e3-98c3-1e1cf6310607" acquired by "delete_volume" :: waited 0.034s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:40 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68343b4-a85e-44ee-b323-6159121c0e2e]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-09fd2d04-4779-4203-a907-08df1abcc8c2 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9db8a65f-5ac7-43e3-98c3-1e1cf6310607 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fdcfaf62-e1b7-4376-9f14-95bcfdc0da39 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fdcfaf62-e1b7-4376-9f14-95bcfdc0da39 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fdcfaf62-e1b7-4376-9f14-95bcfdc0da39 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:40 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fdcfaf62-e1b7-4376-9f14-95bcfdc0da39 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fdcfaf62-e1b7-4376-9f14-95bcfdc0da39 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdcfaf62-e1b7-4376-9f14-95bcfdc0da39 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:40 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:53:40 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:40 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9db8a65f-5ac7-43e3-98c3-1e1cf6310607 Jul 08 14:53:40 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:40 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-41b6a810-9f8a-4e8e-bfed-57457088db55 tempest-VolumeDependencyTests-321806918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99" returned: 0 in 1.178s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-41b6a810-9f8a-4e8e-bfed-57457088db55 tempest-VolumeDependencyTests-321806918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:40 devstack sudo[106485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99 Jul 08 14:53:40 devstack sudo[106485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:41 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5ff35b90-2251-4fb4-baae-3d333582ca39 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.073s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:41 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-5ff35b90-2251-4fb4-baae-3d333582ca39 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:41 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5ff35b90-2251-4fb4-baae-3d333582ca39 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Deleted volume successfully. Jul 08 14:53:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5ff35b90-2251-4fb4-baae-3d333582ca39 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-116e82b0-b8a3-494c-91f2-d137bbe15fba-delete_volume" released by "delete_volume" :: held 3.441s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:41 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fdcfaf62-e1b7-4376-9f14-95bcfdc0da39 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.140s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:41 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-fdcfaf62-e1b7-4376-9f14-95bcfdc0da39 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:41 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fdcfaf62-e1b7-4376-9f14-95bcfdc0da39 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Deleted volume successfully. Jul 08 14:53:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fdcfaf62-e1b7-4376-9f14-95bcfdc0da39 tempest-VolumeAndVolumeTypeFromImageTest-1523416999 None] Lock "cinder-bc4304db-9c7e-41ac-966d-e82c8bcb453b-delete_volume" released by "delete_volume" :: held 4.578s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:41 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-09fd2d04-4779-4203-a907-08df1abcc8c2 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9db8a65f-5ac7-43e3-98c3-1e1cf6310607" returned: 0 in 1.406s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-09fd2d04-4779-4203-a907-08df1abcc8c2 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9db8a65f-5ac7-43e3-98c3-1e1cf6310607 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:41 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9db8a65f-5ac7-43e3-98c3-1e1cf6310607 Jul 08 14:53:41 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:41 devstack sudo[106485]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-41b6a810-9f8a-4e8e-bfed-57457088db55 tempest-VolumeDependencyTests-321806918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582.9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99" returned: 0 in 1.036s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-41b6a810-9f8a-4e8e-bfed-57457088db55 tempest-VolumeDependencyTests-321806918 None] Lock "cinder-quobyte-9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99" released by "_delete_snapshot" :: held 4.638s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-41b6a810-9f8a-4e8e-bfed-57457088db55 tempest-VolumeDependencyTests-321806918 None] Lock "cinder-quobyte-9ffdef47-d751-4d8d-a867-95122860b582" released by "delete_snapshot" :: held 4.671s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:41 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-41b6a810-9f8a-4e8e-bfed-57457088db55 tempest-VolumeDependencyTests-321806918 None] Created reservations ['e91b00f3-a9c0-4d65-bc9d-4a4439b17237', '3d8200ab-8c7e-41a9-9915-7e04f12a4a3e', 'ebf2e658-0193-4366-b594-fab6391ea32f', 'cedcb822-c096-4354-874b-df5986f00a29'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-41b6a810-9f8a-4e8e-bfed-57457088db55 tempest-VolumeDependencyTests-321806918 None] Delete snapshot completed successfully. Jul 08 14:53:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-41b6a810-9f8a-4e8e-bfed-57457088db55 tempest-VolumeDependencyTests-321806918 None] Lock "cinder-9b1ab36c-5a52-47e0-b3b8-1b6b24c6df99-delete_snapshot" released by "delete_snapshot" :: held 4.842s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-69945435-10a1-4696-908c-ac96b180cdce tempest-ProjectAdminTests-1518928356 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.744213104248, 'free_capacity_gb': 1775.744213104248, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87240) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 14:53:42 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-09fd2d04-4779-4203-a907-08df1abcc8c2 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9db8a65f-5ac7-43e3-98c3-1e1cf6310607" returned: 0 in 0.770s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-09fd2d04-4779-4203-a907-08df1abcc8c2 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-quobyte-9db8a65f-5ac7-43e3-98c3-1e1cf6310607" released by "delete_volume" :: held 2.248s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8a54b7ca-e002-442e-85f0-d1110ab8d871 tempest-VolumeDependencyTests-321806918 None] Acquiring lock "cinder-9ffdef47-d751-4d8d-a867-95122860b582-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8a54b7ca-e002-442e-85f0-d1110ab8d871 tempest-VolumeDependencyTests-321806918 None] Lock "cinder-9ffdef47-d751-4d8d-a867-95122860b582-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:42 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-09fd2d04-4779-4203-a907-08df1abcc8c2 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Created reservations ['1cc50d5f-bf6c-48c0-b77b-c3da01e8f8c8', 'f480594f-fbd8-44b0-b602-cd232c1403d8', '2c38cd4b-9b68-46ec-a392-b5f9cf8f877b', '72aa4816-826b-489c-9fc5-2b99ee93b587'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8a54b7ca-e002-442e-85f0-d1110ab8d871 tempest-VolumeDependencyTests-321806918 None] Acquiring lock "cinder-quobyte-9ffdef47-d751-4d8d-a867-95122860b582" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8a54b7ca-e002-442e-85f0-d1110ab8d871 tempest-VolumeDependencyTests-321806918 None] Lock "cinder-quobyte-9ffdef47-d751-4d8d-a867-95122860b582" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:42 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c09dca1-d912-4a26-976c-70f4856c9dbc]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8a54b7ca-e002-442e-85f0-d1110ab8d871 tempest-VolumeDependencyTests-321806918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-09fd2d04-4779-4203-a907-08df1abcc8c2 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-09fd2d04-4779-4203-a907-08df1abcc8c2 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-09fd2d04-4779-4203-a907-08df1abcc8c2 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-09fd2d04-4779-4203-a907-08df1abcc8c2 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-09fd2d04-4779-4203-a907-08df1abcc8c2 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-09fd2d04-4779-4203-a907-08df1abcc8c2 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:42 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:53:42 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:42 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582 Jul 08 14:53:42 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:43 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-09fd2d04-4779-4203-a907-08df1abcc8c2 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.920s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:43 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-09fd2d04-4779-4203-a907-08df1abcc8c2 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:43 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-09fd2d04-4779-4203-a907-08df1abcc8c2 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Deleted volume successfully. Jul 08 14:53:43 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8a54b7ca-e002-442e-85f0-d1110ab8d871 tempest-VolumeDependencyTests-321806918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582" returned: 0 in 0.987s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8a54b7ca-e002-442e-85f0-d1110ab8d871 tempest-VolumeDependencyTests-321806918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-09fd2d04-4779-4203-a907-08df1abcc8c2 tempest-CreateVolumesFromSourceVolumeTest-71114398 None] Lock "cinder-9db8a65f-5ac7-43e3-98c3-1e1cf6310607-delete_volume" released by "delete_volume" :: held 3.594s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:43 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582 Jul 08 14:53:43 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:44 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8a54b7ca-e002-442e-85f0-d1110ab8d871 tempest-VolumeDependencyTests-321806918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9ffdef47-d751-4d8d-a867-95122860b582" returned: 0 in 0.786s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8a54b7ca-e002-442e-85f0-d1110ab8d871 tempest-VolumeDependencyTests-321806918 None] Lock "cinder-quobyte-9ffdef47-d751-4d8d-a867-95122860b582" released by "delete_volume" :: held 1.868s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:44 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-8a54b7ca-e002-442e-85f0-d1110ab8d871 tempest-VolumeDependencyTests-321806918 None] Created reservations ['6a89a06b-dacd-4281-ad8f-45d2af93d861', 'a3b6cf03-740e-4609-b1fe-865284be1d47', '70bafd6d-3473-4327-963f-623186acf94e', '66fe72a8-a47e-4275-ab63-4123ae5f7956'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8a54b7ca-e002-442e-85f0-d1110ab8d871 tempest-VolumeDependencyTests-321806918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8a54b7ca-e002-442e-85f0-d1110ab8d871 tempest-VolumeDependencyTests-321806918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8a54b7ca-e002-442e-85f0-d1110ab8d871 tempest-VolumeDependencyTests-321806918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8a54b7ca-e002-442e-85f0-d1110ab8d871 tempest-VolumeDependencyTests-321806918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8a54b7ca-e002-442e-85f0-d1110ab8d871 tempest-VolumeDependencyTests-321806918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8a54b7ca-e002-442e-85f0-d1110ab8d871 tempest-VolumeDependencyTests-321806918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:44 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:53:44 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4e838437-04e1-4069-a8b2-c4e509b717cc tempest-VolumeDependencyTests-321806918 None] Acquiring lock "cinder-42a1b084-bed1-40ae-861a-12d9933ab894-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4e838437-04e1-4069-a8b2-c4e509b717cc tempest-VolumeDependencyTests-321806918 None] Lock "cinder-42a1b084-bed1-40ae-861a-12d9933ab894-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4e838437-04e1-4069-a8b2-c4e509b717cc tempest-VolumeDependencyTests-321806918 None] Acquiring lock "cinder-quobyte-42a1b084-bed1-40ae-861a-12d9933ab894" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4e838437-04e1-4069-a8b2-c4e509b717cc tempest-VolumeDependencyTests-321806918 None] Lock "cinder-quobyte-42a1b084-bed1-40ae-861a-12d9933ab894" acquired by "delete_volume" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:45 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[40373d14-a53b-4d81-a21c-5d588fdb8ed2]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4e838437-04e1-4069-a8b2-c4e509b717cc tempest-VolumeDependencyTests-321806918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-42a1b084-bed1-40ae-861a-12d9933ab894 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:45 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-42a1b084-bed1-40ae-861a-12d9933ab894 Jul 08 14:53:45 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:45 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8a54b7ca-e002-442e-85f0-d1110ab8d871 tempest-VolumeDependencyTests-321806918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.043s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:45 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-8a54b7ca-e002-442e-85f0-d1110ab8d871 tempest-VolumeDependencyTests-321806918 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:45 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8a54b7ca-e002-442e-85f0-d1110ab8d871 tempest-VolumeDependencyTests-321806918 None] Deleted volume successfully. Jul 08 14:53:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8a54b7ca-e002-442e-85f0-d1110ab8d871 tempest-VolumeDependencyTests-321806918 None] Lock "cinder-9ffdef47-d751-4d8d-a867-95122860b582-delete_volume" released by "delete_volume" :: held 3.247s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:46 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4e838437-04e1-4069-a8b2-c4e509b717cc tempest-VolumeDependencyTests-321806918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-42a1b084-bed1-40ae-861a-12d9933ab894" returned: 0 in 1.020s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4e838437-04e1-4069-a8b2-c4e509b717cc tempest-VolumeDependencyTests-321806918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-42a1b084-bed1-40ae-861a-12d9933ab894 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:46 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-42a1b084-bed1-40ae-861a-12d9933ab894 Jul 08 14:53:46 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:46 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:53:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Flow 'volume_create_manager' (9d392d22-5de0-4793-8965-131885767678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf4ebe7-b71d-4964-b7fb-2297554a8cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:46 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecf4ebe7-b71d-4964-b7fb-2297554a8cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-533858724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e036089-48e2-4755-9a5e-f9e66c7951b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34d9e2c9b0445d0a3e872b56da03fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:47Z,use_quota=True,user_id='16c753e1796043709934da70f95d1753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be140c63-d190-4add-80e4-a75cf9352cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be140c63-d190-4add-80e4-a75cf9352cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b3e587e-788f-43d2-b4cf-d9d0eb494891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b3e587e-788f-43d2-b4cf-d9d0eb494891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e036089-48e2-4755-9a5e-f9e66c7951b4', 'volume_name': 'volume-0e036089-48e2-4755-9a5e-f9e66c7951b4', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26090257-e705-4cdf-9876-daf3bb301b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26090257-e705-4cdf-9876-daf3bb301b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd8073e-0a96-49fc-be66-09d5672f826a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:47 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Volume 0e036089-48e2-4755-9a5e-f9e66c7951b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e036089-48e2-4755-9a5e-f9e66c7951b4', 'volume_size': 1} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-533858724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e036089-48e2-4755-9a5e-f9e66c7951b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34d9e2c9b0445d0a3e872b56da03fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:47Z,use_quota=True,user_id='16c753e1796043709934da70f95d1753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Creating volume 0e036089-48e2-4755-9a5e-f9e66c7951b4 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:47 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0e036089-48e2-4755-9a5e-f9e66c7951b4 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:47 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0e036089-48e2-4755-9a5e-f9e66c7951b4 1073741824 Jul 08 14:53:47 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:47 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4e838437-04e1-4069-a8b2-c4e509b717cc tempest-VolumeDependencyTests-321806918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-42a1b084-bed1-40ae-861a-12d9933ab894" returned: 0 in 1.062s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4e838437-04e1-4069-a8b2-c4e509b717cc tempest-VolumeDependencyTests-321806918 None] Lock "cinder-quobyte-42a1b084-bed1-40ae-861a-12d9933ab894" released by "delete_volume" :: held 2.172s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-4e838437-04e1-4069-a8b2-c4e509b717cc tempest-VolumeDependencyTests-321806918 None] Created reservations ['ad245137-4e85-4878-bcdd-b9115c5b3224', 'b63b75dc-05be-458a-9fd7-3718df310e00', 'ae1d67ac-2bdb-4e6e-a2b8-dc56e9db5616', 'bf3c4ffa-c8e8-4281-ad42-9166dfd145d0'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Flow 'volume_create_manager' (2e464c4b-7381-405d-8027-15f4470340b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8921ca98-8db8-4a14-9d69-f2eef5f37fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8921ca98-8db8-4a14-9d69-f2eef5f37fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1505952784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34d9e2c9b0445d0a3e872b56da03fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:47Z,use_quota=True,user_id='16c753e1796043709934da70f95d1753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513d470e-5e40-44ac-9601-7d1f31264969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513d470e-5e40-44ac-9601-7d1f31264969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00cba0ae-6106-49e2-b91d-4d42e13d464a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00cba0ae-6106-49e2-b91d-4d42e13d464a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d', 'volume_name': 'volume-43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d7c429-a767-4ebd-9a26-e7a474593bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7d7c429-a767-4ebd-9a26-e7a474593bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa45ad2-0b63-4881-a59e-1b64de5e8219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:47 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Volume 43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d', 'volume_size': 1} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4e838437-04e1-4069-a8b2-c4e509b717cc tempest-VolumeDependencyTests-321806918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4e838437-04e1-4069-a8b2-c4e509b717cc tempest-VolumeDependencyTests-321806918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4e838437-04e1-4069-a8b2-c4e509b717cc tempest-VolumeDependencyTests-321806918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4e838437-04e1-4069-a8b2-c4e509b717cc tempest-VolumeDependencyTests-321806918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4e838437-04e1-4069-a8b2-c4e509b717cc tempest-VolumeDependencyTests-321806918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4e838437-04e1-4069-a8b2-c4e509b717cc tempest-VolumeDependencyTests-321806918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:47 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:53:47 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Flow 'volume_create_manager' (f0e97521-7d3f-4c16-8f36-1b6c42695947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1df74a-c826-465c-a9a2-4e0f317bcaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea1df74a-c826-465c-a9a2-4e0f317bcaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2135021726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=484465bb-8b3b-461a-8e2e-fcec65f270c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34d9e2c9b0445d0a3e872b56da03fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:48Z,use_quota=True,user_id='16c753e1796043709934da70f95d1753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba11aa34-2842-4c82-8e00-be27ad2eba5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba11aa34-2842-4c82-8e00-be27ad2eba5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07dc2bf4-ad47-4a62-928f-c475a12b7199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07dc2bf4-ad47-4a62-928f-c475a12b7199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '484465bb-8b3b-461a-8e2e-fcec65f270c6', 'volume_name': 'volume-484465bb-8b3b-461a-8e2e-fcec65f270c6', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7531711-a912-4ced-a217-d1adea9ebbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7531711-a912-4ced-a217-d1adea9ebbf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (446ed403-5405-4037-8002-38e091481438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:48 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Volume 484465bb-8b3b-461a-8e2e-fcec65f270c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-484465bb-8b3b-461a-8e2e-fcec65f270c6', 'volume_size': 1} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:48 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0e036089-48e2-4755-9a5e-f9e66c7951b4 1073741824" returned: 0 in 1.419s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0e036089-48e2-4755-9a5e-f9e66c7951b4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:48 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0e036089-48e2-4755-9a5e-f9e66c7951b4 Jul 08 14:53:48 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:48 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4e838437-04e1-4069-a8b2-c4e509b717cc tempest-VolumeDependencyTests-321806918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.925s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-4e838437-04e1-4069-a8b2-c4e509b717cc tempest-VolumeDependencyTests-321806918 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Flow 'volume_create_manager' (84a04d7e-f2ff-4978-a65c-3d1f9d8fa2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5390c7c-93ef-4de5-b398-1bb55be72705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:48 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4e838437-04e1-4069-a8b2-c4e509b717cc tempest-VolumeDependencyTests-321806918 None] Deleted volume successfully. Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5390c7c-93ef-4de5-b398-1bb55be72705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1160193051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be6f38e5-71e6-4d79-b491-296ac726de0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34d9e2c9b0445d0a3e872b56da03fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:49Z,use_quota=True,user_id='16c753e1796043709934da70f95d1753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990086d8-f7ce-4671-b08a-4e8fb1168a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (990086d8-f7ce-4671-b08a-4e8fb1168a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e113251-8f07-4d5b-8b85-4f8c9039fa78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e113251-8f07-4d5b-8b85-4f8c9039fa78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be6f38e5-71e6-4d79-b491-296ac726de0f', 'volume_name': 'volume-be6f38e5-71e6-4d79-b491-296ac726de0f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd99e733-bc9a-410b-9786-79d10322a524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd99e733-bc9a-410b-9786-79d10322a524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050a6a5d-b9a3-48cc-a05f-24cef68f6377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:48 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Volume be6f38e5-71e6-4d79-b491-296ac726de0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be6f38e5-71e6-4d79-b491-296ac726de0f', 'volume_size': 1} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4e838437-04e1-4069-a8b2-c4e509b717cc tempest-VolumeDependencyTests-321806918 None] Lock "cinder-42a1b084-bed1-40ae-861a-12d9933ab894-delete_volume" released by "delete_volume" :: held 3.842s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Flow 'volume_create_manager' (ea757eba-d058-4fec-8d4c-1dae487975a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7c7b07-0690-4906-a7dd-9f25980a9ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e7c7b07-0690-4906-a7dd-9f25980a9ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1841879075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1352c795-646c-416d-bc24-eb08023e7dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34d9e2c9b0445d0a3e872b56da03fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:49Z,use_quota=True,user_id='16c753e1796043709934da70f95d1753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1d78ce-9f2a-4473-ba2c-387120f0f090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab1d78ce-9f2a-4473-ba2c-387120f0f090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba749703-97be-47ab-8e58-9455701f70f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba749703-97be-47ab-8e58-9455701f70f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1352c795-646c-416d-bc24-eb08023e7dc4', 'volume_name': 'volume-1352c795-646c-416d-bc24-eb08023e7dc4', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c9567a-fd2b-4fdd-a779-951055bb533c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2c9567a-fd2b-4fdd-a779-951055bb533c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (132667b6-6f09-4757-a77f-ddc8ec09093d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:49 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Volume 1352c795-646c-416d-bc24-eb08023e7dc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1352c795-646c-416d-bc24-eb08023e7dc4', 'volume_size': 1} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:49 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0e036089-48e2-4755-9a5e-f9e66c7951b4" returned: 0 in 0.973s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] <== create_volume: return (2459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.461s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.913s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1505952784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34d9e2c9b0445d0a3e872b56da03fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:47Z,use_quota=True,user_id='16c753e1796043709934da70f95d1753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Creating volume 43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:49 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfd8073e-0a96-49fc-be66-09d5672f826a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e036089-48e2-4755-9a5e-f9e66c7951b4', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:49 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d 1073741824 Jul 08 14:53:49 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16505677-c165-4ae5-91e6-47e9b98b25ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:49 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Volume volume-0e036089-48e2-4755-9a5e-f9e66c7951b4 (0e036089-48e2-4755-9a5e-f9e66c7951b4): created successfully Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16505677-c165-4ae5-91e6-47e9b98b25ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:49 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Flow 'volume_create_manager' (9d392d22-5de0-4793-8965-131885767678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:49 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-50d5d6e7-18ae-4e45-88fe-62f41ecf764e tempest-CreateVolumesFromImageTest-191461612 None] Created volume successfully. Jul 08 14:53:50 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d 1073741824" returned: 0 in 1.219s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:50 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d Jul 08 14:53:50 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:51 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d" returned: 0 in 0.950s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] <== create_volume: return (2243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.245s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.505s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2135021726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=484465bb-8b3b-461a-8e2e-fcec65f270c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34d9e2c9b0445d0a3e872b56da03fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:48Z,use_quota=True,user_id='16c753e1796043709934da70f95d1753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Creating volume 484465bb-8b3b-461a-8e2e-fcec65f270c6 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:51 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:53:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-484465bb-8b3b-461a-8e2e-fcec65f270c6 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa45ad2-0b63-4881-a59e-1b64de5e8219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:51 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-484465bb-8b3b-461a-8e2e-fcec65f270c6 1073741824 Jul 08 14:53:51 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9861cc07-61e9-40bf-8397-144e387fd11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:51 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Volume volume-43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d (43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d): created successfully Jul 08 14:53:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9861cc07-61e9-40bf-8397-144e387fd11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:51 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Flow 'volume_create_manager' (2e464c4b-7381-405d-8027-15f4470340b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:51 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0a8a8982-19ca-4457-8d35-4b3503453e8e tempest-CreateVolumesFromImageTest-191461612 None] Created volume successfully. Jul 08 14:53:53 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-484465bb-8b3b-461a-8e2e-fcec65f270c6 1073741824" returned: 0 in 1.401s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-484465bb-8b3b-461a-8e2e-fcec65f270c6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:53 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-484465bb-8b3b-461a-8e2e-fcec65f270c6 Jul 08 14:53:53 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:53 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:53:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Flow 'volume_create_manager' (85068f41-86c8-4910-9a75-37e52ea32693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46796b28-2edd-4edc-ace4-cd2319eb4b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46796b28-2edd-4edc-ace4-cd2319eb4b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8ba491a-51b2-476d-a2d5-0eafbf6b8f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='804e50f67b5e4598af88fed98d55dd7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:53Z,use_quota=True,user_id='5167dea454dd4015ad5b226c949a07b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e6ffbe-b4f2-4b8d-9afd-cfef1672e408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e6ffbe-b4f2-4b8d-9afd-cfef1672e408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c395b5-827c-474a-b7db-11efa74582f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09c395b5-827c-474a-b7db-11efa74582f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8ba491a-51b2-476d-a2d5-0eafbf6b8f51', 'volume_name': 'volume-b8ba491a-51b2-476d-a2d5-0eafbf6b8f51', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3afedc0-6c67-44b6-8ba2-ed00cf75557f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3afedc0-6c67-44b6-8ba2-ed00cf75557f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:53 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae87dc30-9cdd-47a3-be8a-389f5d86cb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:53 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Volume b8ba491a-51b2-476d-a2d5-0eafbf6b8f51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8ba491a-51b2-476d-a2d5-0eafbf6b8f51', 'volume_size': 1} Jul 08 14:53:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:54 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-484465bb-8b3b-461a-8e2e-fcec65f270c6" returned: 0 in 0.846s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] <== create_volume: return (2306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.313s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.228s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1160193051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be6f38e5-71e6-4d79-b491-296ac726de0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34d9e2c9b0445d0a3e872b56da03fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:49Z,use_quota=True,user_id='16c753e1796043709934da70f95d1753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Creating volume be6f38e5-71e6-4d79-b491-296ac726de0f {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:54 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:53:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-be6f38e5-71e6-4d79-b491-296ac726de0f 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:54 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-be6f38e5-71e6-4d79-b491-296ac726de0f 1073741824 Jul 08 14:53:54 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (446ed403-5405-4037-8002-38e091481438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-484465bb-8b3b-461a-8e2e-fcec65f270c6', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16f8dc9-15e2-43e4-bfcf-18d1fa15e9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:54 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Volume volume-484465bb-8b3b-461a-8e2e-fcec65f270c6 (484465bb-8b3b-461a-8e2e-fcec65f270c6): created successfully Jul 08 14:53:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d16f8dc9-15e2-43e4-bfcf-18d1fa15e9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Flow 'volume_create_manager' (f0e97521-7d3f-4c16-8f36-1b6c42695947) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:54 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4253a71e-ef60-4814-b38e-e7dcf2427bd4 tempest-CreateVolumesFromImageTest-191461612 None] Created volume successfully. Jul 08 14:53:55 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-be6f38e5-71e6-4d79-b491-296ac726de0f 1073741824" returned: 0 in 0.960s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-be6f38e5-71e6-4d79-b491-296ac726de0f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:55 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-be6f38e5-71e6-4d79-b491-296ac726de0f Jul 08 14:53:55 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:55 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-be6f38e5-71e6-4d79-b491-296ac726de0f" returned: 0 in 0.669s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] <== create_volume: return (1690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.285s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1841879075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1352c795-646c-416d-bc24-eb08023e7dc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c34d9e2c9b0445d0a3e872b56da03fa3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:49Z,use_quota=True,user_id='16c753e1796043709934da70f95d1753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Creating volume 1352c795-646c-416d-bc24-eb08023e7dc4 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:55 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:55 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:53:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1352c795-646c-416d-bc24-eb08023e7dc4 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:55 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1352c795-646c-416d-bc24-eb08023e7dc4 1073741824 Jul 08 14:53:55 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050a6a5d-b9a3-48cc-a05f-24cef68f6377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be6f38e5-71e6-4d79-b491-296ac726de0f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf11a23-ebbc-4e88-9e54-977d54c2be65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:55 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Volume volume-be6f38e5-71e6-4d79-b491-296ac726de0f (be6f38e5-71e6-4d79-b491-296ac726de0f): created successfully Jul 08 14:53:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf11a23-ebbc-4e88-9e54-977d54c2be65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:55 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Flow 'volume_create_manager' (84a04d7e-f2ff-4978-a65c-3d1f9d8fa2b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:55 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b7312cd6-cea4-4872-ad47-2c42668726d0 tempest-CreateVolumesFromImageTest-191461612 None] Created volume successfully. Jul 08 14:53:56 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1352c795-646c-416d-bc24-eb08023e7dc4 1073741824" returned: 0 in 0.925s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1352c795-646c-416d-bc24-eb08023e7dc4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:56 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1352c795-646c-416d-bc24-eb08023e7dc4 Jul 08 14:53:56 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:57 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1352c795-646c-416d-bc24-eb08023e7dc4" returned: 0 in 0.771s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] <== create_volume: return (1777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.168s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8ba491a-51b2-476d-a2d5-0eafbf6b8f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='804e50f67b5e4598af88fed98d55dd7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:53:53Z,use_quota=True,user_id='5167dea454dd4015ad5b226c949a07b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:53:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Creating volume b8ba491a-51b2-476d-a2d5-0eafbf6b8f51 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:53:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:53:57 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:53:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8ba491a-51b2-476d-a2d5-0eafbf6b8f51 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:57 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8ba491a-51b2-476d-a2d5-0eafbf6b8f51 1073741824 Jul 08 14:53:57 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (132667b6-6f09-4757-a77f-ddc8ec09093d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1352c795-646c-416d-bc24-eb08023e7dc4', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c9864c-060f-431d-8d55-223daa018a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:57 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Volume volume-1352c795-646c-416d-bc24-eb08023e7dc4 (1352c795-646c-416d-bc24-eb08023e7dc4): created successfully Jul 08 14:53:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c9864c-060f-431d-8d55-223daa018a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Flow 'volume_create_manager' (ea757eba-d058-4fec-8d4c-1dae487975a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:57 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0844d84f-e0e4-41fe-bddc-fe6e93e15585 tempest-CreateVolumesFromImageTest-191461612 None] Created volume successfully. Jul 08 14:53:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4975a99c-7ad0-4972-9062-e332e0544d4a tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "cinder-1352c795-646c-416d-bc24-eb08023e7dc4-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4975a99c-7ad0-4972-9062-e332e0544d4a tempest-CreateVolumesFromImageTest-191461612 None] Lock "cinder-1352c795-646c-416d-bc24-eb08023e7dc4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4975a99c-7ad0-4972-9062-e332e0544d4a tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "cinder-quobyte-1352c795-646c-416d-bc24-eb08023e7dc4" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:53:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4975a99c-7ad0-4972-9062-e332e0544d4a tempest-CreateVolumesFromImageTest-191461612 None] Lock "cinder-quobyte-1352c795-646c-416d-bc24-eb08023e7dc4" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:53:58 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7010cc1b-0d58-40c6-9c74-7820fc6f4f78]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:53:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4975a99c-7ad0-4972-9062-e332e0544d4a tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1352c795-646c-416d-bc24-eb08023e7dc4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:58 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8ba491a-51b2-476d-a2d5-0eafbf6b8f51 1073741824" returned: 0 in 1.023s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8ba491a-51b2-476d-a2d5-0eafbf6b8f51 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:58 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1352c795-646c-416d-bc24-eb08023e7dc4 Jul 08 14:53:58 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:58 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8ba491a-51b2-476d-a2d5-0eafbf6b8f51 Jul 08 14:53:58 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:53:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:53:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:53:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:53:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:53:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:59 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4975a99c-7ad0-4972-9062-e332e0544d4a tempest-CreateVolumesFromImageTest-191461612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1352c795-646c-416d-bc24-eb08023e7dc4" returned: 0 in 0.891s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:59 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:53:59 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4975a99c-7ad0-4972-9062-e332e0544d4a tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1352c795-646c-416d-bc24-eb08023e7dc4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:53:59 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1352c795-646c-416d-bc24-eb08023e7dc4 Jul 08 14:53:59 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:53:59 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jul 08 14:53:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8ba491a-51b2-476d-a2d5-0eafbf6b8f51" returned: 0 in 0.859s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:53:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:53:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.939s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:53:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae87dc30-9cdd-47a3-be8a-389f5d86cb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8ba491a-51b2-476d-a2d5-0eafbf6b8f51', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e35833b-2013-49fa-b5c4-caa12a3dd266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:53:59 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Volume volume-b8ba491a-51b2-476d-a2d5-0eafbf6b8f51 (b8ba491a-51b2-476d-a2d5-0eafbf6b8f51): created successfully Jul 08 14:53:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e35833b-2013-49fa-b5c4-caa12a3dd266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:53:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Flow 'volume_create_manager' (85068f41-86c8-4910-9a75-37e52ea32693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:53:59 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-47ff5d99-40a2-48f4-8830-1d4120bf6763 tempest-CinderUnicodeTest-396368293 None] Created volume successfully. Jul 08 14:54:00 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.101s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:54:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:54:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:54:00 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4975a99c-7ad0-4972-9062-e332e0544d4a tempest-CreateVolumesFromImageTest-191461612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1352c795-646c-416d-bc24-eb08023e7dc4" returned: 0 in 1.142s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4975a99c-7ad0-4972-9062-e332e0544d4a tempest-CreateVolumesFromImageTest-191461612 None] Lock "cinder-quobyte-1352c795-646c-416d-bc24-eb08023e7dc4" released by "delete_volume" :: held 2.098s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:00 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-4975a99c-7ad0-4972-9062-e332e0544d4a tempest-CreateVolumesFromImageTest-191461612 None] Created reservations ['b83c842b-1e39-4c59-9be4-282d5e0e0d5b', '8ce9014e-9220-4179-807e-cc87599147d2', 'c4547c0c-a80f-4bce-913c-073b7867fe91', 'ebf3d52b-8777-4e64-a274-16e6babbe37b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:00 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=105,cinder:UPDATE=137,cinder:DELETE=14,cinder:INSERT=44 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:54:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4975a99c-7ad0-4972-9062-e332e0544d4a tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4975a99c-7ad0-4972-9062-e332e0544d4a tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4975a99c-7ad0-4972-9062-e332e0544d4a tempest-CreateVolumesFromImageTest-191461612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4975a99c-7ad0-4972-9062-e332e0544d4a tempest-CreateVolumesFromImageTest-191461612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4975a99c-7ad0-4972-9062-e332e0544d4a tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4975a99c-7ad0-4972-9062-e332e0544d4a tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:00 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:54:00 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3944b1d4-6671-4c6c-b697-30b099b15fc5 tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "cinder-be6f38e5-71e6-4d79-b491-296ac726de0f-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3944b1d4-6671-4c6c-b697-30b099b15fc5 tempest-CreateVolumesFromImageTest-191461612 None] Lock "cinder-be6f38e5-71e6-4d79-b491-296ac726de0f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3944b1d4-6671-4c6c-b697-30b099b15fc5 tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "cinder-quobyte-be6f38e5-71e6-4d79-b491-296ac726de0f" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3944b1d4-6671-4c6c-b697-30b099b15fc5 tempest-CreateVolumesFromImageTest-191461612 None] Lock "cinder-quobyte-be6f38e5-71e6-4d79-b491-296ac726de0f" acquired by "delete_volume" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3a9840-7bda-45ae-8aea-a682f05a4449]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3944b1d4-6671-4c6c-b697-30b099b15fc5 tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-be6f38e5-71e6-4d79-b491-296ac726de0f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:01 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-be6f38e5-71e6-4d79-b491-296ac726de0f Jul 08 14:54:01 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=152,cinder:SELECT=114,cinder:INSERT=39,cinder:DELETE=13 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Flow 'volume_create_manager' (16077003-bd5a-4477-915b-38f28f68bc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f986b918-101c-4b24-9e58-e2ef92f22799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f986b918-101c-4b24-9e58-e2ef92f22799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1308262953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e49d2b1c-02c6-4b38-9ac5-46a95c45041f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f2a705845349cea974ee3355d8b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:01Z,use_quota=True,user_id='9a8e1a48636043f98dd223ab9abf06db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7496b0bf-d486-47fe-b6aa-edbd1a0bf8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7496b0bf-d486-47fe-b6aa-edbd1a0bf8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca4e908-48c4-4e3d-8f7a-b1110382cf14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ca4e908-48c4-4e3d-8f7a-b1110382cf14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e49d2b1c-02c6-4b38-9ac5-46a95c45041f', 'volume_name': 'volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c643f3be-e3b4-4bcb-97a3-a249d7884818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c643f3be-e3b4-4bcb-97a3-a249d7884818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08cb910a-8c12-456c-809e-f0906217ae03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:01 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Volume e49d2b1c-02c6-4b38-9ac5-46a95c45041f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f', 'volume_size': 1} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1308262953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e49d2b1c-02c6-4b38-9ac5-46a95c45041f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f2a705845349cea974ee3355d8b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:01Z,use_quota=True,user_id='9a8e1a48636043f98dd223ab9abf06db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Creating volume e49d2b1c-02c6-4b38-9ac5-46a95c45041f {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:54:01 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:01 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f 1073741824 Jul 08 14:54:01 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:01 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4975a99c-7ad0-4972-9062-e332e0544d4a tempest-CreateVolumesFromImageTest-191461612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.213s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:01 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-4975a99c-7ad0-4972-9062-e332e0544d4a tempest-CreateVolumesFromImageTest-191461612 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:02 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4975a99c-7ad0-4972-9062-e332e0544d4a tempest-CreateVolumesFromImageTest-191461612 None] Deleted volume successfully. Jul 08 14:54:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4975a99c-7ad0-4972-9062-e332e0544d4a tempest-CreateVolumesFromImageTest-191461612 None] Lock "cinder-1352c795-646c-416d-bc24-eb08023e7dc4-delete_volume" released by "delete_volume" :: held 3.660s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:02 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Flow 'volume_create_manager' (530805be-33d5-4da1-b813-4b0b67c1ba57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4876e24a-bfff-4235-aa96-d98dae5bb98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4876e24a-bfff-4235-aa96-d98dae5bb98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1273637500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329bcfc0-0737-47c6-ad06-eac343f0945a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='804e50f67b5e4598af88fed98d55dd7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:02Z,use_quota=True,user_id='5167dea454dd4015ad5b226c949a07b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10812e81-c8c6-4f51-ad21-656080c79e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10812e81-c8c6-4f51-ad21-656080c79e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (597084c1-2572-4061-a341-07bc3a267f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (597084c1-2572-4061-a341-07bc3a267f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '329bcfc0-0737-47c6-ad06-eac343f0945a', 'volume_name': 'volume-329bcfc0-0737-47c6-ad06-eac343f0945a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81bb1a50-0e43-4ce2-a0aa-e8f31e6aaadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81bb1a50-0e43-4ce2-a0aa-e8f31e6aaadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:02 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ba0a85-1170-4c10-99e4-f68e66b810ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:02 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Volume 329bcfc0-0737-47c6-ad06-eac343f0945a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-329bcfc0-0737-47c6-ad06-eac343f0945a', 'volume_size': 1} Jul 08 14:54:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:02 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3944b1d4-6671-4c6c-b697-30b099b15fc5 tempest-CreateVolumesFromImageTest-191461612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-be6f38e5-71e6-4d79-b491-296ac726de0f" returned: 0 in 1.287s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3944b1d4-6671-4c6c-b697-30b099b15fc5 tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-be6f38e5-71e6-4d79-b491-296ac726de0f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:02 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-be6f38e5-71e6-4d79-b491-296ac726de0f Jul 08 14:54:02 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:02 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f 1073741824" returned: 0 in 1.143s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:02 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f Jul 08 14:54:02 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:03 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3944b1d4-6671-4c6c-b697-30b099b15fc5 tempest-CreateVolumesFromImageTest-191461612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-be6f38e5-71e6-4d79-b491-296ac726de0f" returned: 0 in 0.922s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3944b1d4-6671-4c6c-b697-30b099b15fc5 tempest-CreateVolumesFromImageTest-191461612 None] Lock "cinder-quobyte-be6f38e5-71e6-4d79-b491-296ac726de0f" released by "delete_volume" :: held 2.279s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-3944b1d4-6671-4c6c-b697-30b099b15fc5 tempest-CreateVolumesFromImageTest-191461612 None] Created reservations ['dc79e479-9ccc-426e-aa66-2aba22832483', '9bc96c5d-c758-458f-8375-6589bfe46d67', '519af304-a7a0-4419-bbb4-c9ba9075b43d', 'e64d888e-4fd0-4877-9c14-1d58a453b2f0'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3944b1d4-6671-4c6c-b697-30b099b15fc5 tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3944b1d4-6671-4c6c-b697-30b099b15fc5 tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3944b1d4-6671-4c6c-b697-30b099b15fc5 tempest-CreateVolumesFromImageTest-191461612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3944b1d4-6671-4c6c-b697-30b099b15fc5 tempest-CreateVolumesFromImageTest-191461612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3944b1d4-6671-4c6c-b697-30b099b15fc5 tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3944b1d4-6671-4c6c-b697-30b099b15fc5 tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:03 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:54:03 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:03 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f" returned: 0 in 0.827s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] <== create_volume: return (2054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.058s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.579s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:02Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1273637500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=329bcfc0-0737-47c6-ad06-eac343f0945a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='804e50f67b5e4598af88fed98d55dd7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:02Z,use_quota=True,user_id='5167dea454dd4015ad5b226c949a07b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Creating volume 329bcfc0-0737-47c6-ad06-eac343f0945a {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:54:03 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:03 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a 1073741824 Jul 08 14:54:03 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08cb910a-8c12-456c-809e-f0906217ae03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (075c95a3-e246-4087-aa1e-2ba7640af2bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:03 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Volume volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f (e49d2b1c-02c6-4b38-9ac5-46a95c45041f): created successfully Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (075c95a3-e246-4087-aa1e-2ba7640af2bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Flow 'volume_create_manager' (16077003-bd5a-4477-915b-38f28f68bc24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:03 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f53ebdd7-7c41-44af-923c-6bab616751d1 tempest-ProjectMemberTests-737282236 None] Created volume successfully. Jul 08 14:54:04 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3944b1d4-6671-4c6c-b697-30b099b15fc5 tempest-CreateVolumesFromImageTest-191461612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.730s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:04 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-3944b1d4-6671-4c6c-b697-30b099b15fc5 tempest-CreateVolumesFromImageTest-191461612 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:04 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3944b1d4-6671-4c6c-b697-30b099b15fc5 tempest-CreateVolumesFromImageTest-191461612 None] Deleted volume successfully. Jul 08 14:54:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3944b1d4-6671-4c6c-b697-30b099b15fc5 tempest-CreateVolumesFromImageTest-191461612 None] Lock "cinder-be6f38e5-71e6-4d79-b491-296ac726de0f-delete_volume" released by "delete_volume" :: held 3.337s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c677016d-d255-4fda-81f6-6f6a2219fcac tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "cinder-484465bb-8b3b-461a-8e2e-fcec65f270c6-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c677016d-d255-4fda-81f6-6f6a2219fcac tempest-CreateVolumesFromImageTest-191461612 None] Lock "cinder-484465bb-8b3b-461a-8e2e-fcec65f270c6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c677016d-d255-4fda-81f6-6f6a2219fcac tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "cinder-quobyte-484465bb-8b3b-461a-8e2e-fcec65f270c6" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c677016d-d255-4fda-81f6-6f6a2219fcac tempest-CreateVolumesFromImageTest-191461612 None] Lock "cinder-quobyte-484465bb-8b3b-461a-8e2e-fcec65f270c6" acquired by "delete_volume" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:04 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b65a5a5-82f1-4cbf-8d20-95c9076cbbf2]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c677016d-d255-4fda-81f6-6f6a2219fcac tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-484465bb-8b3b-461a-8e2e-fcec65f270c6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:04 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-484465bb-8b3b-461a-8e2e-fcec65f270c6 Jul 08 14:54:04 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:04 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a 1073741824" returned: 0 in 1.192s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:05 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a Jul 08 14:54:05 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-671a820a-d8d5-469a-ace3-2b032f88c0d7 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:05 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c677016d-d255-4fda-81f6-6f6a2219fcac tempest-CreateVolumesFromImageTest-191461612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-484465bb-8b3b-461a-8e2e-fcec65f270c6" returned: 0 in 0.857s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c677016d-d255-4fda-81f6-6f6a2219fcac tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-484465bb-8b3b-461a-8e2e-fcec65f270c6 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:05 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-484465bb-8b3b-461a-8e2e-fcec65f270c6 Jul 08 14:54:05 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:05 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a" returned: 0 in 0.892s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] <== create_volume: return (2157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:54:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.160s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-671a820a-d8d5-469a-ace3-2b032f88c0d7 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.666s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1ba0a85-1170-4c10-99e4-f68e66b810ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-329bcfc0-0737-47c6-ad06-eac343f0945a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:05 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7809309-aeb8-4189-9780-ae13d33e3860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-671a820a-d8d5-469a-ace3-2b032f88c0d7 tempest-ProjectMemberTests-737282236 None] Creating offline snapshot 993ed82a-4a19-4c8f-bfc3-5765def5a415 of volume e49d2b1c-02c6-4b38-9ac5-46a95c45041f {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:54:06 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Volume volume-329bcfc0-0737-47c6-ad06-eac343f0945a (329bcfc0-0737-47c6-ad06-eac343f0945a): created successfully Jul 08 14:54:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7809309-aeb8-4189-9780-ae13d33e3860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Flow 'volume_create_manager' (530805be-33d5-4da1-b813-4b0b67c1ba57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:06 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78f8499-5e61-46dd-b5d2-39d6436dfe67]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-671a820a-d8d5-469a-ace3-2b032f88c0d7 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:06 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-37a00bc8-1e98-4bde-8d0c-014e9394ef6b tempest-CinderUnicodeTest-396368293 None] Created volume successfully. Jul 08 14:54:06 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f Jul 08 14:54:06 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:06 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c677016d-d255-4fda-81f6-6f6a2219fcac tempest-CreateVolumesFromImageTest-191461612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-484465bb-8b3b-461a-8e2e-fcec65f270c6" returned: 0 in 0.797s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c677016d-d255-4fda-81f6-6f6a2219fcac tempest-CreateVolumesFromImageTest-191461612 None] Lock "cinder-quobyte-484465bb-8b3b-461a-8e2e-fcec65f270c6" released by "delete_volume" :: held 1.711s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:06 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-c677016d-d255-4fda-81f6-6f6a2219fcac tempest-CreateVolumesFromImageTest-191461612 None] Created reservations ['aed23867-e083-4029-b1a4-d13ca09b7c84', '8f3df15f-1d76-4f13-bcbd-997b9afc10ad', '95e52f5b-6b2d-4768-ada4-a7d1e1154268', 'd7c77dc4-abc7-4a66-9fbe-e0d21055fdea'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c677016d-d255-4fda-81f6-6f6a2219fcac tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c677016d-d255-4fda-81f6-6f6a2219fcac tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c677016d-d255-4fda-81f6-6f6a2219fcac tempest-CreateVolumesFromImageTest-191461612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c677016d-d255-4fda-81f6-6f6a2219fcac tempest-CreateVolumesFromImageTest-191461612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c677016d-d255-4fda-81f6-6f6a2219fcac tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c677016d-d255-4fda-81f6-6f6a2219fcac tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:06 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:54:06 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-26e34477-576b-484e-80e0-92379be5e6f5 tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "cinder-43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-26e34477-576b-484e-80e0-92379be5e6f5 tempest-CreateVolumesFromImageTest-191461612 None] Lock "cinder-43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c1c522ad-4920-4368-9896-fbc711cbd709 tempest-CinderUnicodeTest-396368293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-26e34477-576b-484e-80e0-92379be5e6f5 tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "cinder-quobyte-43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-26e34477-576b-484e-80e0-92379be5e6f5 tempest-CreateVolumesFromImageTest-191461612 None] Lock "cinder-quobyte-43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d" acquired by "delete_volume" :: waited 0.033s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:06 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-671a820a-d8d5-469a-ace3-2b032f88c0d7 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f" returned: 0 in 0.986s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-671a820a-d8d5-469a-ace3-2b032f88c0d7 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.993ed82a-4a19-4c8f-bfc3-5765def5a415 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:07 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c551f494-f3df-491a-8a6b-769b8db35daa]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26e34477-576b-484e-80e0-92379be5e6f5 tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:07 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.993ed82a-4a19-4c8f-bfc3-5765def5a415 1G Jul 08 14:54:07 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:07 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d Jul 08 14:54:07 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:07 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c677016d-d255-4fda-81f6-6f6a2219fcac tempest-CreateVolumesFromImageTest-191461612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.185s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:07 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-c677016d-d255-4fda-81f6-6f6a2219fcac tempest-CreateVolumesFromImageTest-191461612 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c677016d-d255-4fda-81f6-6f6a2219fcac tempest-CreateVolumesFromImageTest-191461612 None] Deleted volume successfully. Jul 08 14:54:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c677016d-d255-4fda-81f6-6f6a2219fcac tempest-CreateVolumesFromImageTest-191461612 None] Lock "cinder-484465bb-8b3b-461a-8e2e-fcec65f270c6-delete_volume" released by "delete_volume" :: held 3.215s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:08 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26e34477-576b-484e-80e0-92379be5e6f5 tempest-CreateVolumesFromImageTest-191461612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d" returned: 0 in 0.990s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26e34477-576b-484e-80e0-92379be5e6f5 tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:08 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d Jul 08 14:54:08 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:08 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-671a820a-d8d5-469a-ace3-2b032f88c0d7 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.993ed82a-4a19-4c8f-bfc3-5765def5a415 1G" returned: 0 in 1.130s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-671a820a-d8d5-469a-ace3-2b032f88c0d7 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.993ed82a-4a19-4c8f-bfc3-5765def5a415 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:08 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.993ed82a-4a19-4c8f-bfc3-5765def5a415 Jul 08 14:54:08 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:08 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26e34477-576b-484e-80e0-92379be5e6f5 tempest-CreateVolumesFromImageTest-191461612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d" returned: 0 in 0.766s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-26e34477-576b-484e-80e0-92379be5e6f5 tempest-CreateVolumesFromImageTest-191461612 None] Lock "cinder-quobyte-43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d" released by "delete_volume" :: held 1.825s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:08 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-26e34477-576b-484e-80e0-92379be5e6f5 tempest-CreateVolumesFromImageTest-191461612 None] Created reservations ['815775ce-5442-4527-961b-841b356142ab', '2c9db146-65e7-41ef-9dde-c86aa78f8d8e', '2cbdcb75-e232-466e-9d85-299c1d3c7cec', '94c390de-8c3c-48a7-92e7-0e3115faadcc'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:08 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-671a820a-d8d5-469a-ace3-2b032f88c0d7 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.993ed82a-4a19-4c8f-bfc3-5765def5a415" returned: 0 in 0.825s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:08 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-671a820a-d8d5-469a-ace3-2b032f88c0d7 tempest-ProjectMemberTests-737282236 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.993ed82a-4a19-4c8f-bfc3-5765def5a415 is being set with open permissions: ugo+rw Jul 08 14:54:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-671a820a-d8d5-469a-ace3-2b032f88c0d7 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.993ed82a-4a19-4c8f-bfc3-5765def5a415 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-26e34477-576b-484e-80e0-92379be5e6f5 tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-26e34477-576b-484e-80e0-92379be5e6f5 tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-26e34477-576b-484e-80e0-92379be5e6f5 tempest-CreateVolumesFromImageTest-191461612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:09 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.993ed82a-4a19-4c8f-bfc3-5765def5a415 Jul 08 14:54:09 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-26e34477-576b-484e-80e0-92379be5e6f5 tempest-CreateVolumesFromImageTest-191461612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-26e34477-576b-484e-80e0-92379be5e6f5 tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26e34477-576b-484e-80e0-92379be5e6f5 tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:09 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:54:09 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aa044436-b83d-436d-b503-fce17d533e96 tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "cinder-0e036089-48e2-4755-9a5e-f9e66c7951b4-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aa044436-b83d-436d-b503-fce17d533e96 tempest-CreateVolumesFromImageTest-191461612 None] Lock "cinder-0e036089-48e2-4755-9a5e-f9e66c7951b4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aa044436-b83d-436d-b503-fce17d533e96 tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "cinder-quobyte-0e036089-48e2-4755-9a5e-f9e66c7951b4" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aa044436-b83d-436d-b503-fce17d533e96 tempest-CreateVolumesFromImageTest-191461612 None] Lock "cinder-quobyte-0e036089-48e2-4755-9a5e-f9e66c7951b4" acquired by "delete_volume" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:09 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[57569ec3-db8a-429d-a616-c897075dc7d0]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa044436-b83d-436d-b503-fce17d533e96 tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0e036089-48e2-4755-9a5e-f9e66c7951b4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:09 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0e036089-48e2-4755-9a5e-f9e66c7951b4 Jul 08 14:54:09 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:09 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-26e34477-576b-484e-80e0-92379be5e6f5 tempest-CreateVolumesFromImageTest-191461612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.824s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:09 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-26e34477-576b-484e-80e0-92379be5e6f5 tempest-CreateVolumesFromImageTest-191461612 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:09 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-26e34477-576b-484e-80e0-92379be5e6f5 tempest-CreateVolumesFromImageTest-191461612 None] Deleted volume successfully. Jul 08 14:54:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-26e34477-576b-484e-80e0-92379be5e6f5 tempest-CreateVolumesFromImageTest-191461612 None] Lock "cinder-43e8c3fb-c7b4-4ff9-ace7-18ff2d80024d-delete_volume" released by "delete_volume" :: held 3.093s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:10 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-671a820a-d8d5-469a-ace3-2b032f88c0d7 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.993ed82a-4a19-4c8f-bfc3-5765def5a415" returned: 0 in 1.075s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-671a820a-d8d5-469a-ace3-2b032f88c0d7 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:10 devstack sudo[106716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.info Jul 08 14:54:10 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:10 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa044436-b83d-436d-b503-fce17d533e96 tempest-CreateVolumesFromImageTest-191461612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0e036089-48e2-4755-9a5e-f9e66c7951b4" returned: 0 in 0.941s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa044436-b83d-436d-b503-fce17d533e96 tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0e036089-48e2-4755-9a5e-f9e66c7951b4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:10 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0e036089-48e2-4755-9a5e-f9e66c7951b4 Jul 08 14:54:10 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:10 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-671a820a-d8d5-469a-ace3-2b032f88c0d7 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.info" returned: 0 in 0.726s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:10 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-671a820a-d8d5-469a-ace3-2b032f88c0d7 tempest-ProjectMemberTests-737282236 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.info is being set with open permissions: ugo+rw Jul 08 14:54:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-671a820a-d8d5-469a-ace3-2b032f88c0d7 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:10 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.info Jul 08 14:54:10 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:10 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa044436-b83d-436d-b503-fce17d533e96 tempest-CreateVolumesFromImageTest-191461612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0e036089-48e2-4755-9a5e-f9e66c7951b4" returned: 0 in 0.683s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aa044436-b83d-436d-b503-fce17d533e96 tempest-CreateVolumesFromImageTest-191461612 None] Lock "cinder-quobyte-0e036089-48e2-4755-9a5e-f9e66c7951b4" released by "delete_volume" :: held 1.717s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:11 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-aa044436-b83d-436d-b503-fce17d533e96 tempest-CreateVolumesFromImageTest-191461612 None] Created reservations ['de4892c7-54d4-4035-9b18-e4a74e8cf52f', '8e02f6e3-2fa5-4f13-85f3-611340d6d3e8', '5f15c84d-3ad2-4e0b-a333-02453e310409', '6c1bd8b8-8b68-4e09-8942-6909306cdefc'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aa044436-b83d-436d-b503-fce17d533e96 tempest-CreateVolumesFromImageTest-191461612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aa044436-b83d-436d-b503-fce17d533e96 tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aa044436-b83d-436d-b503-fce17d533e96 tempest-CreateVolumesFromImageTest-191461612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aa044436-b83d-436d-b503-fce17d533e96 tempest-CreateVolumesFromImageTest-191461612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aa044436-b83d-436d-b503-fce17d533e96 tempest-CreateVolumesFromImageTest-191461612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa044436-b83d-436d-b503-fce17d533e96 tempest-CreateVolumesFromImageTest-191461612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:11 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:54:11 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:11 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-671a820a-d8d5-469a-ace3-2b032f88c0d7 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.info" returned: 0 in 0.708s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-671a820a-d8d5-469a-ace3-2b032f88c0d7 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.603s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c1c522ad-4920-4368-9896-fbc711cbd709 tempest-CinderUnicodeTest-396368293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.608s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-c1c522ad-4920-4368-9896-fbc711cbd709 tempest-CinderUnicodeTest-396368293 None] Creating offline snapshot d10cd426-beaa-4bd0-a04f-6f8f92b0ea42 of volume 329bcfc0-0737-47c6-ad06-eac343f0945a {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:54:11 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc75624-90a4-462b-ba56-e02e493fe476]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1c522ad-4920-4368-9896-fbc711cbd709 tempest-CinderUnicodeTest-396368293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:11 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-671a820a-d8d5-469a-ace3-2b032f88c0d7 tempest-ProjectMemberTests-737282236 None] Create snapshot completed successfully Jul 08 14:54:11 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a Jul 08 14:54:11 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:11 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aa044436-b83d-436d-b503-fce17d533e96 tempest-CreateVolumesFromImageTest-191461612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.823s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:11 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-aa044436-b83d-436d-b503-fce17d533e96 tempest-CreateVolumesFromImageTest-191461612 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:11 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-aa044436-b83d-436d-b503-fce17d533e96 tempest-CreateVolumesFromImageTest-191461612 None] Deleted volume successfully. Jul 08 14:54:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-aa044436-b83d-436d-b503-fce17d533e96 tempest-CreateVolumesFromImageTest-191461612 None] Lock "cinder-0e036089-48e2-4755-9a5e-f9e66c7951b4-delete_volume" released by "delete_volume" :: held 2.832s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:12 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1c522ad-4920-4368-9896-fbc711cbd709 tempest-CinderUnicodeTest-396368293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a" returned: 0 in 0.953s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1c522ad-4920-4368-9896-fbc711cbd709 tempest-CinderUnicodeTest-396368293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.d10cd426-beaa-4bd0-a04f-6f8f92b0ea42 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:12 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.d10cd426-beaa-4bd0-a04f-6f8f92b0ea42 1G Jul 08 14:54:12 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-80b0ee83-7ee0-4d45-b25d-54f648fca432 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-993ed82a-4a19-4c8f-bfc3-5765def5a415-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-80b0ee83-7ee0-4d45-b25d-54f648fca432 tempest-ProjectMemberTests-737282236 None] Lock "cinder-993ed82a-4a19-4c8f-bfc3-5765def5a415-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-80b0ee83-7ee0-4d45-b25d-54f648fca432 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-e49d2b1c-02c6-4b38-9ac5-46a95c45041f" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-80b0ee83-7ee0-4d45-b25d-54f648fca432 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-e49d2b1c-02c6-4b38-9ac5-46a95c45041f" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-80b0ee83-7ee0-4d45-b25d-54f648fca432 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-993ed82a-4a19-4c8f-bfc3-5765def5a415" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-80b0ee83-7ee0-4d45-b25d-54f648fca432 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-993ed82a-4a19-4c8f-bfc3-5765def5a415" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-80b0ee83-7ee0-4d45-b25d-54f648fca432 tempest-ProjectMemberTests-737282236 None] Deleting offline snapshot 993ed82a-4a19-4c8f-bfc3-5765def5a415 of volume e49d2b1c-02c6-4b38-9ac5-46a95c45041f {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:54:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-80b0ee83-7ee0-4d45-b25d-54f648fca432 tempest-ProjectMemberTests-737282236 None] snapshot_file for this snap is: volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.993ed82a-4a19-4c8f-bfc3-5765def5a415 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:54:12 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da7d888-823c-489c-9f7e-43b6695f557a]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-80b0ee83-7ee0-4d45-b25d-54f648fca432 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.993ed82a-4a19-4c8f-bfc3-5765def5a415 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:12 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.993ed82a-4a19-4c8f-bfc3-5765def5a415 Jul 08 14:54:13 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:13 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1c522ad-4920-4368-9896-fbc711cbd709 tempest-CinderUnicodeTest-396368293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.d10cd426-beaa-4bd0-a04f-6f8f92b0ea42 1G" returned: 0 in 1.244s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1c522ad-4920-4368-9896-fbc711cbd709 tempest-CinderUnicodeTest-396368293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-329bcfc0-0737-47c6-ad06-eac343f0945a -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.d10cd426-beaa-4bd0-a04f-6f8f92b0ea42 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:13 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-329bcfc0-0737-47c6-ad06-eac343f0945a -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.d10cd426-beaa-4bd0-a04f-6f8f92b0ea42 Jul 08 14:54:13 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:14 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-80b0ee83-7ee0-4d45-b25d-54f648fca432 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.993ed82a-4a19-4c8f-bfc3-5765def5a415" returned: 0 in 1.198s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-80b0ee83-7ee0-4d45-b25d-54f648fca432 tempest-ProjectMemberTests-737282236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:54:14 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d11122-1ae9-4681-abbe-7d9cbed69526]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-80b0ee83-7ee0-4d45-b25d-54f648fca432 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:14 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f Jul 08 14:54:14 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:14 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1c522ad-4920-4368-9896-fbc711cbd709 tempest-CinderUnicodeTest-396368293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-329bcfc0-0737-47c6-ad06-eac343f0945a -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.d10cd426-beaa-4bd0-a04f-6f8f92b0ea42" returned: 0 in 0.913s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:14 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-c1c522ad-4920-4368-9896-fbc711cbd709 tempest-CinderUnicodeTest-396368293 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.d10cd426-beaa-4bd0-a04f-6f8f92b0ea42 is being set with open permissions: ugo+rw Jul 08 14:54:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1c522ad-4920-4368-9896-fbc711cbd709 tempest-CinderUnicodeTest-396368293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.d10cd426-beaa-4bd0-a04f-6f8f92b0ea42 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:14 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.d10cd426-beaa-4bd0-a04f-6f8f92b0ea42 Jul 08 14:54:14 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:15 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-80b0ee83-7ee0-4d45-b25d-54f648fca432 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f" returned: 0 in 1.215s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-80b0ee83-7ee0-4d45-b25d-54f648fca432 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.993ed82a-4a19-4c8f-bfc3-5765def5a415 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:15 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.993ed82a-4a19-4c8f-bfc3-5765def5a415 Jul 08 14:54:15 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:15 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Flow 'volume_create_manager' (27201b94-d42e-4b3a-b4e4-53929a6b27b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b34c9b-204e-49b2-b311-b0399f5f422e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88b34c9b-204e-49b2-b311-b0399f5f422e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1129011498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d5b301-7caa-45ac-a344-e64cf22239aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0082cbfe1ede4ffa85593d31ae358136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:15Z,use_quota=True,user_id='23fbba770a904b1fb4f84e880c60982f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d30b9a5-5a8b-48bf-8b59-472280fb9b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d30b9a5-5a8b-48bf-8b59-472280fb9b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314030de-f173-4455-9474-a1c975609fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314030de-f173-4455-9474-a1c975609fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9d5b301-7caa-45ac-a344-e64cf22239aa', 'volume_name': 'volume-a9d5b301-7caa-45ac-a344-e64cf22239aa', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42558a7-cd71-479f-8f94-cdcf143ec3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42558a7-cd71-479f-8f94-cdcf143ec3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfef1413-3f9e-46a5-8567-541559feb44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:15 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Volume a9d5b301-7caa-45ac-a344-e64cf22239aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9d5b301-7caa-45ac-a344-e64cf22239aa', 'volume_size': 1} Jul 08 14:54:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:16 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1c522ad-4920-4368-9896-fbc711cbd709 tempest-CinderUnicodeTest-396368293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.d10cd426-beaa-4bd0-a04f-6f8f92b0ea42" returned: 0 in 1.335s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1c522ad-4920-4368-9896-fbc711cbd709 tempest-CinderUnicodeTest-396368293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:16 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.info Jul 08 14:54:16 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:16 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-80b0ee83-7ee0-4d45-b25d-54f648fca432 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.993ed82a-4a19-4c8f-bfc3-5765def5a415" returned: 0 in 1.027s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-80b0ee83-7ee0-4d45-b25d-54f648fca432 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.993ed82a-4a19-4c8f-bfc3-5765def5a415 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:16 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.993ed82a-4a19-4c8f-bfc3-5765def5a415 Jul 08 14:54:16 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:16 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1c522ad-4920-4368-9896-fbc711cbd709 tempest-CinderUnicodeTest-396368293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.info" returned: 0 in 0.798s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:16 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-c1c522ad-4920-4368-9896-fbc711cbd709 tempest-CinderUnicodeTest-396368293 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.info is being set with open permissions: ugo+rw Jul 08 14:54:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1c522ad-4920-4368-9896-fbc711cbd709 tempest-CinderUnicodeTest-396368293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:16 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.info Jul 08 14:54:16 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:17 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-80b0ee83-7ee0-4d45-b25d-54f648fca432 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f.993ed82a-4a19-4c8f-bfc3-5765def5a415" returned: 0 in 0.729s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-80b0ee83-7ee0-4d45-b25d-54f648fca432 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-993ed82a-4a19-4c8f-bfc3-5765def5a415" released by "_delete_snapshot" :: held 4.356s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-80b0ee83-7ee0-4d45-b25d-54f648fca432 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-e49d2b1c-02c6-4b38-9ac5-46a95c45041f" released by "delete_snapshot" :: held 4.388s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:17 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-80b0ee83-7ee0-4d45-b25d-54f648fca432 tempest-ProjectMemberTests-737282236 None] Created reservations ['9b7df10a-8bca-4c9f-ba45-663929b24c31', 'c246959b-8b10-4d38-9d9a-9d9181221345', 'e37a4232-7bb5-43f5-b9b6-3059794dc28b', '88b3119d-100c-4641-b285-70f8e4d54c4c'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:17 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-80b0ee83-7ee0-4d45-b25d-54f648fca432 tempest-ProjectMemberTests-737282236 None] Delete snapshot completed successfully. Jul 08 14:54:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-80b0ee83-7ee0-4d45-b25d-54f648fca432 tempest-ProjectMemberTests-737282236 None] Lock "cinder-993ed82a-4a19-4c8f-bfc3-5765def5a415-delete_snapshot" released by "delete_snapshot" :: held 4.585s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:17 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c1c522ad-4920-4368-9896-fbc711cbd709 tempest-CinderUnicodeTest-396368293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.info" returned: 0 in 0.777s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c1c522ad-4920-4368-9896-fbc711cbd709 tempest-CinderUnicodeTest-396368293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.135s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.924s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1129011498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9d5b301-7caa-45ac-a344-e64cf22239aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0082cbfe1ede4ffa85593d31ae358136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:15Z,use_quota=True,user_id='23fbba770a904b1fb4f84e880c60982f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:54:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Creating volume a9d5b301-7caa-45ac-a344-e64cf22239aa {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:54:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:54:17 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:54:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:17 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa 1073741824 Jul 08 14:54:17 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:17 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c1c522ad-4920-4368-9896-fbc711cbd709 tempest-CinderUnicodeTest-396368293 None] Create snapshot completed successfully Jul 08 14:54:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d70eb6d4-d126-4534-a396-2d65722f2f68 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-e49d2b1c-02c6-4b38-9ac5-46a95c45041f-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d70eb6d4-d126-4534-a396-2d65722f2f68 tempest-ProjectMemberTests-737282236 None] Lock "cinder-e49d2b1c-02c6-4b38-9ac5-46a95c45041f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d70eb6d4-d126-4534-a396-2d65722f2f68 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-e49d2b1c-02c6-4b38-9ac5-46a95c45041f" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d70eb6d4-d126-4534-a396-2d65722f2f68 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-e49d2b1c-02c6-4b38-9ac5-46a95c45041f" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:18 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[654502ab-eb91-42bc-a3bf-c9a3dc6e8467]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d70eb6d4-d126-4534-a396-2d65722f2f68 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:18 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f Jul 08 14:54:18 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50b27cf2-cf6a-42d3-88ac-655f9703cd75 tempest-CinderUnicodeTest-396368293 None] Acquiring lock "cinder-d10cd426-beaa-4bd0-a04f-6f8f92b0ea42-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50b27cf2-cf6a-42d3-88ac-655f9703cd75 tempest-CinderUnicodeTest-396368293 None] Lock "cinder-d10cd426-beaa-4bd0-a04f-6f8f92b0ea42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50b27cf2-cf6a-42d3-88ac-655f9703cd75 tempest-CinderUnicodeTest-396368293 None] Acquiring lock "cinder-quobyte-329bcfc0-0737-47c6-ad06-eac343f0945a" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50b27cf2-cf6a-42d3-88ac-655f9703cd75 tempest-CinderUnicodeTest-396368293 None] Lock "cinder-quobyte-329bcfc0-0737-47c6-ad06-eac343f0945a" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50b27cf2-cf6a-42d3-88ac-655f9703cd75 tempest-CinderUnicodeTest-396368293 None] Acquiring lock "cinder-quobyte-d10cd426-beaa-4bd0-a04f-6f8f92b0ea42" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50b27cf2-cf6a-42d3-88ac-655f9703cd75 tempest-CinderUnicodeTest-396368293 None] Lock "cinder-quobyte-d10cd426-beaa-4bd0-a04f-6f8f92b0ea42" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-50b27cf2-cf6a-42d3-88ac-655f9703cd75 tempest-CinderUnicodeTest-396368293 None] Deleting offline snapshot d10cd426-beaa-4bd0-a04f-6f8f92b0ea42 of volume 329bcfc0-0737-47c6-ad06-eac343f0945a {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:54:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-50b27cf2-cf6a-42d3-88ac-655f9703cd75 tempest-CinderUnicodeTest-396368293 None] snapshot_file for this snap is: volume-329bcfc0-0737-47c6-ad06-eac343f0945a.d10cd426-beaa-4bd0-a04f-6f8f92b0ea42 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:54:18 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b393f5bc-aa76-4973-8aa3-6c86d81ef560]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50b27cf2-cf6a-42d3-88ac-655f9703cd75 tempest-CinderUnicodeTest-396368293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.d10cd426-beaa-4bd0-a04f-6f8f92b0ea42 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:18 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:18 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.d10cd426-beaa-4bd0-a04f-6f8f92b0ea42 Jul 08 14:54:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa 1073741824" returned: 0 in 1.171s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:18 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:18 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa Jul 08 14:54:18 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:19 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d70eb6d4-d126-4534-a396-2d65722f2f68 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f" returned: 0 in 1.052s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d70eb6d4-d126-4534-a396-2d65722f2f68 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:19 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f Jul 08 14:54:19 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:19 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50b27cf2-cf6a-42d3-88ac-655f9703cd75 tempest-CinderUnicodeTest-396368293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.d10cd426-beaa-4bd0-a04f-6f8f92b0ea42" returned: 0 in 0.977s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-50b27cf2-cf6a-42d3-88ac-655f9703cd75 tempest-CinderUnicodeTest-396368293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-329bcfc0-0737-47c6-ad06-eac343f0945a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:54:19 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25c6d79-50dd-4987-9e89-036b6527b68b]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50b27cf2-cf6a-42d3-88ac-655f9703cd75 tempest-CinderUnicodeTest-396368293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:19 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa" returned: 0 in 0.919s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] <== create_volume: return (2154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:54:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.159s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfef1413-3f9e-46a5-8567-541559feb44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9d5b301-7caa-45ac-a344-e64cf22239aa', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d352ac05-4ea7-48a8-9efc-d1aa1c3528c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:19 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a Jul 08 14:54:19 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:19 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Volume volume-a9d5b301-7caa-45ac-a344-e64cf22239aa (a9d5b301-7caa-45ac-a344-e64cf22239aa): created successfully Jul 08 14:54:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d352ac05-4ea7-48a8-9efc-d1aa1c3528c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:19 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Flow 'volume_create_manager' (27201b94-d42e-4b3a-b4e4-53929a6b27b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:19 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-1463b22f-7d9f-4ec4-bdbc-f996491a9110 tempest-CreateVolumesFromSnapshotTest-989353771 None] Created volume successfully. Jul 08 14:54:20 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d70eb6d4-d126-4534-a396-2d65722f2f68 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e49d2b1c-02c6-4b38-9ac5-46a95c45041f" returned: 0 in 0.943s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:20 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d70eb6d4-d126-4534-a396-2d65722f2f68 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-e49d2b1c-02c6-4b38-9ac5-46a95c45041f" released by "delete_volume" :: held 2.077s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:20 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-d70eb6d4-d126-4534-a396-2d65722f2f68 tempest-ProjectMemberTests-737282236 None] Created reservations ['ea0c49a2-870c-4a87-8b12-8ffdf768c1bd', '21e2d30d-7782-4a26-8f90-e22066944187', 'ad74bc9c-eb4d-4d71-a427-806d7347d9dc', 'b7ca622d-2254-4f1e-8e4b-e70781ad811e'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d70eb6d4-d126-4534-a396-2d65722f2f68 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d70eb6d4-d126-4534-a396-2d65722f2f68 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d70eb6d4-d126-4534-a396-2d65722f2f68 tempest-ProjectMemberTests-737282236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:20 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d70eb6d4-d126-4534-a396-2d65722f2f68 tempest-ProjectMemberTests-737282236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d70eb6d4-d126-4534-a396-2d65722f2f68 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d70eb6d4-d126-4534-a396-2d65722f2f68 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:20 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:54:20 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:20 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50b27cf2-cf6a-42d3-88ac-655f9703cd75 tempest-CinderUnicodeTest-396368293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a" returned: 0 in 0.882s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50b27cf2-cf6a-42d3-88ac-655f9703cd75 tempest-CinderUnicodeTest-396368293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.d10cd426-beaa-4bd0-a04f-6f8f92b0ea42 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:20 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.d10cd426-beaa-4bd0-a04f-6f8f92b0ea42 Jul 08 14:54:20 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:21 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d70eb6d4-d126-4534-a396-2d65722f2f68 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.968s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:21 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-d70eb6d4-d126-4534-a396-2d65722f2f68 tempest-ProjectMemberTests-737282236 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:21 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d70eb6d4-d126-4534-a396-2d65722f2f68 tempest-ProjectMemberTests-737282236 None] Deleted volume successfully. Jul 08 14:54:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d70eb6d4-d126-4534-a396-2d65722f2f68 tempest-ProjectMemberTests-737282236 None] Lock "cinder-e49d2b1c-02c6-4b38-9ac5-46a95c45041f-delete_volume" released by "delete_volume" :: held 3.341s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a1664ed-f807-48a0-95dc-b562c4b10824 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a1664ed-f807-48a0-95dc-b562c4b10824 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:21 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0a1664ed-f807-48a0-95dc-b562c4b10824 tempest-CreateVolumesFromSnapshotTest-989353771 None] Creating offline snapshot 55422eb3-e947-4798-a46e-46820ff2a83e of volume a9d5b301-7caa-45ac-a344-e64cf22239aa {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:54:21 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4fa380-9d6c-4cfe-a59e-c3d10bb8b751]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a1664ed-f807-48a0-95dc-b562c4b10824 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:21 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50b27cf2-cf6a-42d3-88ac-655f9703cd75 tempest-CinderUnicodeTest-396368293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.d10cd426-beaa-4bd0-a04f-6f8f92b0ea42" returned: 0 in 1.024s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50b27cf2-cf6a-42d3-88ac-655f9703cd75 tempest-CinderUnicodeTest-396368293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.d10cd426-beaa-4bd0-a04f-6f8f92b0ea42 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:21 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.d10cd426-beaa-4bd0-a04f-6f8f92b0ea42 Jul 08 14:54:21 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:21 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa Jul 08 14:54:21 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:22 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Flow 'volume_create_manager' (4fe35cd4-4cfa-43a1-8fc4-5bd667063afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f50113-e586-45e0-a957-db414dc5bd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6f50113-e586-45e0-a957-db414dc5bd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1472222204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c64dbaf-1dcd-4e18-aa3f-682b9473899a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f2a705845349cea974ee3355d8b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:22Z,use_quota=True,user_id='9a8e1a48636043f98dd223ab9abf06db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc6ccbb-4b21-421e-b818-e55590c3f7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc6ccbb-4b21-421e-b818-e55590c3f7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:22 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc92478-cf65-497b-8c3a-44bd17dce204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc92478-cf65-497b-8c3a-44bd17dce204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c64dbaf-1dcd-4e18-aa3f-682b9473899a', 'volume_name': 'volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (746c12f7-6fc2-498d-ba59-56b54d9fd4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (746c12f7-6fc2-498d-ba59-56b54d9fd4e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df9e876-9159-4c04-9c1d-5277d6cdcb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:22 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Volume 0c64dbaf-1dcd-4e18-aa3f-682b9473899a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a', 'volume_size': 1} Jul 08 14:54:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50b27cf2-cf6a-42d3-88ac-655f9703cd75 tempest-CinderUnicodeTest-396368293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a.d10cd426-beaa-4bd0-a04f-6f8f92b0ea42" returned: 0 in 0.859s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50b27cf2-cf6a-42d3-88ac-655f9703cd75 tempest-CinderUnicodeTest-396368293 None] Lock "cinder-quobyte-d10cd426-beaa-4bd0-a04f-6f8f92b0ea42" released by "_delete_snapshot" :: held 3.932s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50b27cf2-cf6a-42d3-88ac-655f9703cd75 tempest-CinderUnicodeTest-396368293 None] Lock "cinder-quobyte-329bcfc0-0737-47c6-ad06-eac343f0945a" released by "delete_snapshot" :: held 3.973s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:22 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-50b27cf2-cf6a-42d3-88ac-655f9703cd75 tempest-CinderUnicodeTest-396368293 None] Created reservations ['a1f6a401-7773-4b60-b6c6-66785a971fc7', 'cf576a24-7245-481a-92d2-45ab24942659', 'feb4b2fa-4c4a-4b54-bb7c-0e1c39542a9c', '3f04370e-e65c-427a-9f88-607d8d1063aa'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:22 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-50b27cf2-cf6a-42d3-88ac-655f9703cd75 tempest-CinderUnicodeTest-396368293 None] Delete snapshot completed successfully. Jul 08 14:54:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50b27cf2-cf6a-42d3-88ac-655f9703cd75 tempest-CinderUnicodeTest-396368293 None] Lock "cinder-d10cd426-beaa-4bd0-a04f-6f8f92b0ea42-delete_snapshot" released by "delete_snapshot" :: held 4.159s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:22 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a1664ed-f807-48a0-95dc-b562c4b10824 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa" returned: 0 in 1.377s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a1664ed-f807-48a0-95dc-b562c4b10824 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.55422eb3-e947-4798-a46e-46820ff2a83e 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:22 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.55422eb3-e947-4798-a46e-46820ff2a83e 1G Jul 08 14:54:22 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-554e06d0-23a8-45a8-95fc-35d64a24aafd tempest-CinderUnicodeTest-396368293 None] Acquiring lock "cinder-329bcfc0-0737-47c6-ad06-eac343f0945a-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-554e06d0-23a8-45a8-95fc-35d64a24aafd tempest-CinderUnicodeTest-396368293 None] Lock "cinder-329bcfc0-0737-47c6-ad06-eac343f0945a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-554e06d0-23a8-45a8-95fc-35d64a24aafd tempest-CinderUnicodeTest-396368293 None] Acquiring lock "cinder-quobyte-329bcfc0-0737-47c6-ad06-eac343f0945a" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-554e06d0-23a8-45a8-95fc-35d64a24aafd tempest-CinderUnicodeTest-396368293 None] Lock "cinder-quobyte-329bcfc0-0737-47c6-ad06-eac343f0945a" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:23 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[317946f9-9238-4366-a166-67d27e0c75b8]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-554e06d0-23a8-45a8-95fc-35d64a24aafd tempest-CinderUnicodeTest-396368293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:23 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a Jul 08 14:54:23 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:23 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Flow 'volume_create_manager' (fa972414-e2e8-4145-8f70-08f1dae5a1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414f387a-477d-46f5-84d6-a528c74b1bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (414f387a-477d-46f5-84d6-a528c74b1bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1703895300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8938422-188b-41d3-a00c-4f152eebaadd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604d1f735d874951a0e8509491b0af97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:23Z,use_quota=True,user_id='fc5692bcebfe4bc8a6e0377737b041b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e35c7d-16ca-4725-bb22-3a70be8a960d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e35c7d-16ca-4725-bb22-3a70be8a960d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1043f1a-747e-45b9-97dc-a3e0623e6621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1043f1a-747e-45b9-97dc-a3e0623e6621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8938422-188b-41d3-a00c-4f152eebaadd', 'volume_name': 'volume-f8938422-188b-41d3-a00c-4f152eebaadd', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92900590-c0be-461c-8363-2f61dd7f8afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92900590-c0be-461c-8363-2f61dd7f8afe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de28e7cb-9b57-4052-93fc-a1d6424222a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:23 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Volume f8938422-188b-41d3-a00c-4f152eebaadd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8938422-188b-41d3-a00c-4f152eebaadd', 'volume_size': 1} Jul 08 14:54:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:23 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a1664ed-f807-48a0-95dc-b562c4b10824 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.55422eb3-e947-4798-a46e-46820ff2a83e 1G" returned: 0 in 0.913s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a1664ed-f807-48a0-95dc-b562c4b10824 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9d5b301-7caa-45ac-a344-e64cf22239aa -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.55422eb3-e947-4798-a46e-46820ff2a83e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:23 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9d5b301-7caa-45ac-a344-e64cf22239aa -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.55422eb3-e947-4798-a46e-46820ff2a83e Jul 08 14:54:23 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:23 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-554e06d0-23a8-45a8-95fc-35d64a24aafd tempest-CinderUnicodeTest-396368293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a" returned: 0 in 0.828s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-554e06d0-23a8-45a8-95fc-35d64a24aafd tempest-CinderUnicodeTest-396368293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:23 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a Jul 08 14:54:23 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:24 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a1664ed-f807-48a0-95dc-b562c4b10824 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9d5b301-7caa-45ac-a344-e64cf22239aa -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.55422eb3-e947-4798-a46e-46820ff2a83e" returned: 0 in 0.717s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:24 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-0a1664ed-f807-48a0-95dc-b562c4b10824 tempest-CreateVolumesFromSnapshotTest-989353771 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.55422eb3-e947-4798-a46e-46820ff2a83e is being set with open permissions: ugo+rw Jul 08 14:54:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a1664ed-f807-48a0-95dc-b562c4b10824 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.55422eb3-e947-4798-a46e-46820ff2a83e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:24 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.55422eb3-e947-4798-a46e-46820ff2a83e Jul 08 14:54:24 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:24 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-554e06d0-23a8-45a8-95fc-35d64a24aafd tempest-CinderUnicodeTest-396368293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-329bcfc0-0737-47c6-ad06-eac343f0945a" returned: 0 in 0.694s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-554e06d0-23a8-45a8-95fc-35d64a24aafd tempest-CinderUnicodeTest-396368293 None] Lock "cinder-quobyte-329bcfc0-0737-47c6-ad06-eac343f0945a" released by "delete_volume" :: held 1.593s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:24 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-554e06d0-23a8-45a8-95fc-35d64a24aafd tempest-CinderUnicodeTest-396368293 None] Created reservations ['c4bc4014-2a6f-453a-b311-f1aa92a58cbc', '8e412f29-7be6-4089-b251-e00526fba38c', 'b08ef6a8-c20c-487c-a861-aa57d75cbc00', '96559e12-85ab-4954-a50b-7df9e6af5c1d'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-554e06d0-23a8-45a8-95fc-35d64a24aafd tempest-CinderUnicodeTest-396368293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-554e06d0-23a8-45a8-95fc-35d64a24aafd tempest-CinderUnicodeTest-396368293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-554e06d0-23a8-45a8-95fc-35d64a24aafd tempest-CinderUnicodeTest-396368293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-554e06d0-23a8-45a8-95fc-35d64a24aafd tempest-CinderUnicodeTest-396368293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-554e06d0-23a8-45a8-95fc-35d64a24aafd tempest-CinderUnicodeTest-396368293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-554e06d0-23a8-45a8-95fc-35d64a24aafd tempest-CinderUnicodeTest-396368293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:24 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:54:24 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f338febb-7f0a-4c62-9d22-515f7a77fc1d tempest-CinderUnicodeTest-396368293 None] Acquiring lock "cinder-b8ba491a-51b2-476d-a2d5-0eafbf6b8f51-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:25 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a1664ed-f807-48a0-95dc-b562c4b10824 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.55422eb3-e947-4798-a46e-46820ff2a83e" returned: 0 in 0.713s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f338febb-7f0a-4c62-9d22-515f7a77fc1d tempest-CinderUnicodeTest-396368293 None] Lock "cinder-b8ba491a-51b2-476d-a2d5-0eafbf6b8f51-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a1664ed-f807-48a0-95dc-b562c4b10824 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f338febb-7f0a-4c62-9d22-515f7a77fc1d tempest-CinderUnicodeTest-396368293 None] Acquiring lock "cinder-quobyte-b8ba491a-51b2-476d-a2d5-0eafbf6b8f51" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:25 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.info Jul 08 14:54:25 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f338febb-7f0a-4c62-9d22-515f7a77fc1d tempest-CinderUnicodeTest-396368293 None] Lock "cinder-quobyte-b8ba491a-51b2-476d-a2d5-0eafbf6b8f51" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:25 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fccdc6b-01b4-42c3-8d51-d0707b58a6d1]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f338febb-7f0a-4c62-9d22-515f7a77fc1d tempest-CinderUnicodeTest-396368293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8ba491a-51b2-476d-a2d5-0eafbf6b8f51 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:25 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8ba491a-51b2-476d-a2d5-0eafbf6b8f51 Jul 08 14:54:25 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:25 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-554e06d0-23a8-45a8-95fc-35d64a24aafd tempest-CinderUnicodeTest-396368293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.738s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:25 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-554e06d0-23a8-45a8-95fc-35d64a24aafd tempest-CinderUnicodeTest-396368293 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:25 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-554e06d0-23a8-45a8-95fc-35d64a24aafd tempest-CinderUnicodeTest-396368293 None] Deleted volume successfully. Jul 08 14:54:25 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-554e06d0-23a8-45a8-95fc-35d64a24aafd tempest-CinderUnicodeTest-396368293 None] Lock "cinder-329bcfc0-0737-47c6-ad06-eac343f0945a-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:26 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a1664ed-f807-48a0-95dc-b562c4b10824 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.info" returned: 0 in 0.697s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:26 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-0a1664ed-f807-48a0-95dc-b562c4b10824 tempest-CreateVolumesFromSnapshotTest-989353771 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.info is being set with open permissions: ugo+rw Jul 08 14:54:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a1664ed-f807-48a0-95dc-b562c4b10824 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:26 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.info Jul 08 14:54:26 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:26 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f338febb-7f0a-4c62-9d22-515f7a77fc1d tempest-CinderUnicodeTest-396368293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8ba491a-51b2-476d-a2d5-0eafbf6b8f51" returned: 0 in 0.843s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f338febb-7f0a-4c62-9d22-515f7a77fc1d tempest-CinderUnicodeTest-396368293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8ba491a-51b2-476d-a2d5-0eafbf6b8f51 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:26 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8ba491a-51b2-476d-a2d5-0eafbf6b8f51 Jul 08 14:54:26 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:26 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0a1664ed-f807-48a0-95dc-b562c4b10824 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.info" returned: 0 in 0.682s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0a1664ed-f807-48a0-95dc-b562c4b10824 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.236s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.178s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1472222204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c64dbaf-1dcd-4e18-aa3f-682b9473899a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f2a705845349cea974ee3355d8b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:22Z,use_quota=True,user_id='9a8e1a48636043f98dd223ab9abf06db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:54:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Creating volume 0c64dbaf-1dcd-4e18-aa3f-682b9473899a {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:54:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:54:26 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:54:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:26 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a 1073741824 Jul 08 14:54:26 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0a1664ed-f807-48a0-95dc-b562c4b10824 tempest-CreateVolumesFromSnapshotTest-989353771 None] Create snapshot completed successfully Jul 08 14:54:26 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f338febb-7f0a-4c62-9d22-515f7a77fc1d tempest-CinderUnicodeTest-396368293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b8ba491a-51b2-476d-a2d5-0eafbf6b8f51" returned: 0 in 0.672s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f338febb-7f0a-4c62-9d22-515f7a77fc1d tempest-CinderUnicodeTest-396368293 None] Lock "cinder-quobyte-b8ba491a-51b2-476d-a2d5-0eafbf6b8f51" released by "delete_volume" :: held 1.574s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:26 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-f338febb-7f0a-4c62-9d22-515f7a77fc1d tempest-CinderUnicodeTest-396368293 None] Created reservations ['68c3dd7d-d3b8-48d4-97f4-e19ae750756c', '35614574-821d-4d7e-a6fd-5becf539677a', 'ad04b913-0812-4e25-835b-86d0a330af3a', '4d347fa5-ed27-4106-84fc-b65454059e22'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f338febb-7f0a-4c62-9d22-515f7a77fc1d tempest-CinderUnicodeTest-396368293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f338febb-7f0a-4c62-9d22-515f7a77fc1d tempest-CinderUnicodeTest-396368293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f338febb-7f0a-4c62-9d22-515f7a77fc1d tempest-CinderUnicodeTest-396368293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f338febb-7f0a-4c62-9d22-515f7a77fc1d tempest-CinderUnicodeTest-396368293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f338febb-7f0a-4c62-9d22-515f7a77fc1d tempest-CinderUnicodeTest-396368293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f338febb-7f0a-4c62-9d22-515f7a77fc1d tempest-CinderUnicodeTest-396368293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:27 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:54:27 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:27 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a 1073741824" returned: 0 in 0.894s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:27 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a Jul 08 14:54:27 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:27 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f338febb-7f0a-4c62-9d22-515f7a77fc1d tempest-CinderUnicodeTest-396368293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.783s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:27 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-f338febb-7f0a-4c62-9d22-515f7a77fc1d tempest-CinderUnicodeTest-396368293 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:27 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f338febb-7f0a-4c62-9d22-515f7a77fc1d tempest-CinderUnicodeTest-396368293 None] Deleted volume successfully. Jul 08 14:54:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f338febb-7f0a-4c62-9d22-515f7a77fc1d tempest-CinderUnicodeTest-396368293 None] Lock "cinder-b8ba491a-51b2-476d-a2d5-0eafbf6b8f51-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Flow 'volume_create_manager' (0efc0ad8-435d-48f4-b74f-f4be86e156a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877132d7-d206-48ca-b1ab-2d6c930031f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:28 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a" returned: 0 in 0.900s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.061s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1703895300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8938422-188b-41d3-a00c-4f152eebaadd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604d1f735d874951a0e8509491b0af97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:23Z,use_quota=True,user_id='fc5692bcebfe4bc8a6e0377737b041b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Creating volume f8938422-188b-41d3-a00c-4f152eebaadd {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:54:28 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877132d7-d206-48ca-b1ab-2d6c930031f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1784444819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59fae403-f4ea-4f8f-8195-3d2fbb1533b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0082cbfe1ede4ffa85593d31ae358136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:28Z,use_quota=True,user_id='23fbba770a904b1fb4f84e880c60982f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09ce480-9961-40da-b92b-456f1310e6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09ce480-9961-40da-b92b-456f1310e6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99614bb1-4e15-490a-a489-5ade0c96f537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99614bb1-4e15-490a-a489-5ade0c96f537) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59fae403-f4ea-4f8f-8195-3d2fbb1533b7', 'volume_name': 'volume-59fae403-f4ea-4f8f-8195-3d2fbb1533b7', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be403fd8-3d2b-4b04-93b4-858139798a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:28 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd 1073741824 Jul 08 14:54:28 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be403fd8-3d2b-4b04-93b4-858139798a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5aa970-ab4c-45ee-8f50-a59d7359c844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:28 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Volume 59fae403-f4ea-4f8f-8195-3d2fbb1533b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59fae403-f4ea-4f8f-8195-3d2fbb1533b7', 'volume_size': 1} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8df9e876-9159-4c04-9c1d-5277d6cdcb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba1550f7-3b4c-4b5c-bc2c-03b2f00c086b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:28 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Volume volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a (0c64dbaf-1dcd-4e18-aa3f-682b9473899a): created successfully Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba1550f7-3b4c-4b5c-bc2c-03b2f00c086b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Flow 'volume_create_manager' (4fe35cd4-4cfa-43a1-8fc4-5bd667063afe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Flow 'volume_create_manager' (8e8181b0-c600-4956-af67-6496d938194e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76cc5b59-385d-4351-9f58-5e12b64c36d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76cc5b59-385d-4351-9f58-5e12b64c36d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-938504601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef44fd8-c44c-4779-bcac-826007eaea5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0082cbfe1ede4ffa85593d31ae358136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:29Z,use_quota=True,user_id='23fbba770a904b1fb4f84e880c60982f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78775495-ef48-444c-9aef-547366b53535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78775495-ef48-444c-9aef-547366b53535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2451759-e11b-4055-afe5-ad1682632f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2451759-e11b-4055-afe5-ad1682632f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ef44fd8-c44c-4779-bcac-826007eaea5d', 'volume_name': 'volume-1ef44fd8-c44c-4779-bcac-826007eaea5d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4e89b8-b915-4b9a-bd7c-e828b339813c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4e89b8-b915-4b9a-bd7c-e828b339813c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (051bed74-8ba7-4dcb-b953-9b4b1353cd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:28 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Volume 1ef44fd8-c44c-4779-bcac-826007eaea5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ef44fd8-c44c-4779-bcac-826007eaea5d', 'volume_size': 1} Jul 08 14:54:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:28 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5469e06e-966f-4a37-9eb5-4c5b88ed50ba tempest-ProjectMemberTests-737282236 None] Created volume successfully. Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Flow 'volume_create_manager' (d3b01e28-3f20-4da4-bd94-47edfcbe8e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a012b4-5d93-4b0b-8f9e-6d9f7abf9cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93a012b4-5d93-4b0b-8f9e-6d9f7abf9cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-74222440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aea6b3d-413e-4dbd-8d82-91bcad29ca46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0082cbfe1ede4ffa85593d31ae358136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:29Z,use_quota=True,user_id='23fbba770a904b1fb4f84e880c60982f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b78da5-959b-41c2-8844-dcda1ccc76f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b78da5-959b-41c2-8844-dcda1ccc76f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0beed469-3405-4b9c-847c-8428ddfd38a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0beed469-3405-4b9c-847c-8428ddfd38a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aea6b3d-413e-4dbd-8d82-91bcad29ca46', 'volume_name': 'volume-6aea6b3d-413e-4dbd-8d82-91bcad29ca46', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576b9662-d605-4788-a464-df1c5253362f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (576b9662-d605-4788-a464-df1c5253362f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d118b51-c8c8-4037-97c3-c53dc2a15467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:29 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Volume 6aea6b3d-413e-4dbd-8d82-91bcad29ca46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aea6b3d-413e-4dbd-8d82-91bcad29ca46', 'volume_size': 1} Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Flow 'volume_create_manager' (f17a18cc-a2cd-43fb-aeae-3a2978dcc5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ce20b4-f18f-49b7-9d1b-e3b874955d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ce20b4-f18f-49b7-9d1b-e3b874955d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1241528877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ce0137-8138-48a5-8e17-5b6e3f3d51bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0082cbfe1ede4ffa85593d31ae358136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:30Z,use_quota=True,user_id='23fbba770a904b1fb4f84e880c60982f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4342af51-809d-4337-903d-dffe6c05cc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4342af51-809d-4337-903d-dffe6c05cc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ccb3c2e-cc3a-41fc-96b1-3a95a7cd0511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ccb3c2e-cc3a-41fc-96b1-3a95a7cd0511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3ce0137-8138-48a5-8e17-5b6e3f3d51bc', 'volume_name': 'volume-c3ce0137-8138-48a5-8e17-5b6e3f3d51bc', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd22156-4114-4ac8-a555-dcb1891d8e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddd22156-4114-4ac8-a555-dcb1891d8e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00427f8d-42b7-4d0f-bcc1-df6d1d6cedbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:29 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Volume c3ce0137-8138-48a5-8e17-5b6e3f3d51bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3ce0137-8138-48a5-8e17-5b6e3f3d51bc', 'volume_size': 1} Jul 08 14:54:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:30 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd 1073741824" returned: 0 in 1.442s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:30 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd Jul 08 14:54:30 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Flow 'volume_create_manager' (709c87d6-15a3-48b2-93cd-d36a536b9f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d998699d-a999-4098-9c50-f9eff5cc5d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d998699d-a999-4098-9c50-f9eff5cc5d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1854522645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0082cbfe1ede4ffa85593d31ae358136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:30Z,use_quota=True,user_id='23fbba770a904b1fb4f84e880c60982f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b260b4-42ea-4dc6-a453-db3f36baf33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7b260b4-42ea-4dc6-a453-db3f36baf33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c23b5b4-9ce3-4d6d-acee-e61aa94ccc32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c23b5b4-9ce3-4d6d-acee-e61aa94ccc32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1', 'volume_name': 'volume-e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6cdbf16-aa4a-4414-b4ec-810d159e41b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6cdbf16-aa4a-4414-b4ec-810d159e41b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7201e3f9-1a22-4254-b25e-e7ad610f0ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:30 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Volume e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1', 'volume_size': 1} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-da9b73f2-20c7-4043-978c-77d81037a6c5 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:30 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd" returned: 0 in 0.747s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] <== create_volume: return (2268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.274s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.158s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1784444819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59fae403-f4ea-4f8f-8195-3d2fbb1533b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0082cbfe1ede4ffa85593d31ae358136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:28Z,use_quota=True,user_id='23fbba770a904b1fb4f84e880c60982f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Creating volume 59fae403-f4ea-4f8f-8195-3d2fbb1533b7 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:54:30 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59fae403-f4ea-4f8f-8195-3d2fbb1533b7 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:30 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59fae403-f4ea-4f8f-8195-3d2fbb1533b7 1073741824 Jul 08 14:54:30 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de28e7cb-9b57-4052-93fc-a1d6424222a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8938422-188b-41d3-a00c-4f152eebaadd', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a507c989-bb28-4459-a6e4-97df195e8d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:30 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Volume volume-f8938422-188b-41d3-a00c-4f152eebaadd (f8938422-188b-41d3-a00c-4f152eebaadd): created successfully Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a507c989-bb28-4459-a6e4-97df195e8d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:30 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Flow 'volume_create_manager' (fa972414-e2e8-4145-8f70-08f1dae5a1f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:30 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5ac33ed5-e24d-4822-9d7f-b6933e819d57 tempest-SnapshotDependencyTests-1617129267 None] Created volume successfully. Jul 08 14:54:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f1475971-8784-45e9-a0ae-d88fd6da1e82 tempest-SnapshotDependencyTests-1617129267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:31 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59fae403-f4ea-4f8f-8195-3d2fbb1533b7 1073741824" returned: 0 in 0.986s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59fae403-f4ea-4f8f-8195-3d2fbb1533b7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:31 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59fae403-f4ea-4f8f-8195-3d2fbb1533b7 Jul 08 14:54:31 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:32 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59fae403-f4ea-4f8f-8195-3d2fbb1533b7" returned: 0 in 0.635s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:54:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.565s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-938504601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ef44fd8-c44c-4779-bcac-826007eaea5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0082cbfe1ede4ffa85593d31ae358136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:29Z,use_quota=True,user_id='23fbba770a904b1fb4f84e880c60982f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:54:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Creating volume 1ef44fd8-c44c-4779-bcac-826007eaea5d {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:54:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:54:32 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:54:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ef44fd8-c44c-4779-bcac-826007eaea5d 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:32 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ef44fd8-c44c-4779-bcac-826007eaea5d 1073741824 Jul 08 14:54:32 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b5aa970-ab4c-45ee-8f50-a59d7359c844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59fae403-f4ea-4f8f-8195-3d2fbb1533b7', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9749ed71-b8b3-491d-8936-45aeca8e93eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:32 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Volume volume-59fae403-f4ea-4f8f-8195-3d2fbb1533b7 (59fae403-f4ea-4f8f-8195-3d2fbb1533b7): created successfully Jul 08 14:54:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9749ed71-b8b3-491d-8936-45aeca8e93eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:32 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Flow 'volume_create_manager' (0efc0ad8-435d-48f4-b74f-f4be86e156a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:32 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-63aa48b3-ea31-42ab-a0f9-bda102a26615 tempest-CreateVolumesFromSnapshotTest-989353771 None] Created volume successfully. Jul 08 14:54:33 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ef44fd8-c44c-4779-bcac-826007eaea5d 1073741824" returned: 0 in 0.888s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ef44fd8-c44c-4779-bcac-826007eaea5d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:33 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ef44fd8-c44c-4779-bcac-826007eaea5d Jul 08 14:54:33 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:34 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ef44fd8-c44c-4779-bcac-826007eaea5d" returned: 0 in 0.754s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:54:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.911s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-74222440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aea6b3d-413e-4dbd-8d82-91bcad29ca46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0082cbfe1ede4ffa85593d31ae358136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:29Z,use_quota=True,user_id='23fbba770a904b1fb4f84e880c60982f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:54:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Creating volume 6aea6b3d-413e-4dbd-8d82-91bcad29ca46 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:54:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:54:34 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:54:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6aea6b3d-413e-4dbd-8d82-91bcad29ca46 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:34 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6aea6b3d-413e-4dbd-8d82-91bcad29ca46 1073741824 Jul 08 14:54:34 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (051bed74-8ba7-4dcb-b953-9b4b1353cd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ef44fd8-c44c-4779-bcac-826007eaea5d', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480439ff-16fa-4364-843d-0689967cee8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:34 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Volume volume-1ef44fd8-c44c-4779-bcac-826007eaea5d (1ef44fd8-c44c-4779-bcac-826007eaea5d): created successfully Jul 08 14:54:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (480439ff-16fa-4364-843d-0689967cee8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:34 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Flow 'volume_create_manager' (8e8181b0-c600-4956-af67-6496d938194e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:34 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-347b4999-d3ab-4469-b646-8288b93b951b tempest-CreateVolumesFromSnapshotTest-989353771 None] Created volume successfully. Jul 08 14:54:35 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6aea6b3d-413e-4dbd-8d82-91bcad29ca46 1073741824" returned: 0 in 0.840s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6aea6b3d-413e-4dbd-8d82-91bcad29ca46 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:35 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6aea6b3d-413e-4dbd-8d82-91bcad29ca46 Jul 08 14:54:35 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:35 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6aea6b3d-413e-4dbd-8d82-91bcad29ca46" returned: 0 in 0.721s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:54:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.062s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1241528877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ce0137-8138-48a5-8e17-5b6e3f3d51bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0082cbfe1ede4ffa85593d31ae358136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:30Z,use_quota=True,user_id='23fbba770a904b1fb4f84e880c60982f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:54:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Creating volume c3ce0137-8138-48a5-8e17-5b6e3f3d51bc {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:54:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:54:35 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:54:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c3ce0137-8138-48a5-8e17-5b6e3f3d51bc 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:35 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c3ce0137-8138-48a5-8e17-5b6e3f3d51bc 1073741824 Jul 08 14:54:35 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d118b51-c8c8-4037-97c3-c53dc2a15467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aea6b3d-413e-4dbd-8d82-91bcad29ca46', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6c9189-7fde-4a48-b646-075411d65e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:35 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Volume volume-6aea6b3d-413e-4dbd-8d82-91bcad29ca46 (6aea6b3d-413e-4dbd-8d82-91bcad29ca46): created successfully Jul 08 14:54:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec6c9189-7fde-4a48-b646-075411d65e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Flow 'volume_create_manager' (d3b01e28-3f20-4da4-bd94-47edfcbe8e95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:35 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2ed3fe12-a00e-4f5a-8515-e4d6e5d6fb62 tempest-CreateVolumesFromSnapshotTest-989353771 None] Created volume successfully. Jul 08 14:54:36 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c3ce0137-8138-48a5-8e17-5b6e3f3d51bc 1073741824" returned: 0 in 0.903s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c3ce0137-8138-48a5-8e17-5b6e3f3d51bc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:36 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c3ce0137-8138-48a5-8e17-5b6e3f3d51bc Jul 08 14:54:36 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:37 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c3ce0137-8138-48a5-8e17-5b6e3f3d51bc" returned: 0 in 0.678s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:54:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.174s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1854522645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0082cbfe1ede4ffa85593d31ae358136',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:30Z,use_quota=True,user_id='23fbba770a904b1fb4f84e880c60982f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:54:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Creating volume e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:54:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:54:37 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:54:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00427f8d-42b7-4d0f-bcc1-df6d1d6cedbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3ce0137-8138-48a5-8e17-5b6e3f3d51bc', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (185af718-0cb1-4903-90b4-852c8f581bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:37 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1 1073741824 Jul 08 14:54:37 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:37 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Volume volume-c3ce0137-8138-48a5-8e17-5b6e3f3d51bc (c3ce0137-8138-48a5-8e17-5b6e3f3d51bc): created successfully Jul 08 14:54:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (185af718-0cb1-4903-90b4-852c8f581bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Flow 'volume_create_manager' (f17a18cc-a2cd-43fb-aeae-3a2978dcc5bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:37 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5b79f668-7e30-4e2f-a98a-cf66e05d7c6c tempest-CreateVolumesFromSnapshotTest-989353771 None] Created volume successfully. Jul 08 14:54:38 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1 1073741824" returned: 0 in 0.903s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:38 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1 Jul 08 14:54:38 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:39 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1" returned: 0 in 0.729s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:54:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-da9b73f2-20c7-4043-978c-77d81037a6c5 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.836s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7201e3f9-1a22-4254-b25e-e7ad610f0ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032da497-2815-4d05-bdbb-3223b318b6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:39 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-da9b73f2-20c7-4043-978c-77d81037a6c5 tempest-ProjectMemberTests-737282236 None] Creating offline snapshot f4274da2-a2f9-4b2f-b9cd-1e303ad3561c of volume 0c64dbaf-1dcd-4e18-aa3f-682b9473899a {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:54:39 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Volume volume-e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1 (e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1): created successfully Jul 08 14:54:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032da497-2815-4d05-bdbb-3223b318b6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:39 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Flow 'volume_create_manager' (709c87d6-15a3-48b2-93cd-d36a536b9f5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:39 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e44c2dc-610b-4263-812c-ee3214a7d74a]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-da9b73f2-20c7-4043-978c-77d81037a6c5 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:39 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bf0c75fc-d62c-42e6-a032-5954d60c1380 tempest-CreateVolumesFromSnapshotTest-989353771 None] Created volume successfully. Jul 08 14:54:39 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a Jul 08 14:54:39 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b3088b95-5b69-4485-8d64-59ae15ae00d8 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "cinder-e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b3088b95-5b69-4485-8d64-59ae15ae00d8 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b3088b95-5b69-4485-8d64-59ae15ae00d8 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "cinder-quobyte-e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b3088b95-5b69-4485-8d64-59ae15ae00d8 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-quobyte-e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:40 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-da9b73f2-20c7-4043-978c-77d81037a6c5 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a" returned: 0 in 0.908s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-da9b73f2-20c7-4043-978c-77d81037a6c5 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.f4274da2-a2f9-4b2f-b9cd-1e303ad3561c 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:40 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12357d3-36cf-44fa-9c47-41d83ee7f930]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b3088b95-5b69-4485-8d64-59ae15ae00d8 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:40 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.f4274da2-a2f9-4b2f-b9cd-1e303ad3561c 1G Jul 08 14:54:40 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:40 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1 Jul 08 14:54:40 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:41 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b3088b95-5b69-4485-8d64-59ae15ae00d8 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1" returned: 0 in 0.858s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:41 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b3088b95-5b69-4485-8d64-59ae15ae00d8 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-da9b73f2-20c7-4043-978c-77d81037a6c5 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.f4274da2-a2f9-4b2f-b9cd-1e303ad3561c 1G" returned: 0 in 0.901s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-da9b73f2-20c7-4043-978c-77d81037a6c5 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.f4274da2-a2f9-4b2f-b9cd-1e303ad3561c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:41 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1 Jul 08 14:54:41 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:41 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.f4274da2-a2f9-4b2f-b9cd-1e303ad3561c Jul 08 14:54:41 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:41 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b3088b95-5b69-4485-8d64-59ae15ae00d8 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1" returned: 0 in 0.746s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b3088b95-5b69-4485-8d64-59ae15ae00d8 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-quobyte-e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1" released by "delete_volume" :: held 1.693s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:41 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:41 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Flow 'volume_create_manager' (c4ab6481-3dc4-47fb-8627-97e2eac7aed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4517ff35-637e-40f0-91c1-38082866a182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-da9b73f2-20c7-4043-978c-77d81037a6c5 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.f4274da2-a2f9-4b2f-b9cd-1e303ad3561c" returned: 0 in 0.839s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:41 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-da9b73f2-20c7-4043-978c-77d81037a6c5 tempest-ProjectMemberTests-737282236 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.f4274da2-a2f9-4b2f-b9cd-1e303ad3561c is being set with open permissions: ugo+rw Jul 08 14:54:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-da9b73f2-20c7-4043-978c-77d81037a6c5 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.f4274da2-a2f9-4b2f-b9cd-1e303ad3561c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:41 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.f4274da2-a2f9-4b2f-b9cd-1e303ad3561c Jul 08 14:54:41 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4517ff35-637e-40f0-91c1-38082866a182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-583844031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b38094da-b9aa-403e-9f6f-46d32f76e4ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e378f56e3f7d411d8096dbe3c116f8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:42Z,use_quota=True,user_id='0ebe803eb5a74f9994c51a28a1ece0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843d8374-0331-433b-9a50-13fdc03bdaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843d8374-0331-433b-9a50-13fdc03bdaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b407323-4484-42d5-b6eb-b3a16880c82b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b407323-4484-42d5-b6eb-b3a16880c82b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b38094da-b9aa-403e-9f6f-46d32f76e4ee', 'volume_name': 'volume-b38094da-b9aa-403e-9f6f-46d32f76e4ee', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff0814a-8901-421f-baeb-95217286f582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff0814a-8901-421f-baeb-95217286f582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (724bd6f3-c8a5-4854-a873-79cea3973f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:41 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Volume b38094da-b9aa-403e-9f6f-46d32f76e4ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b38094da-b9aa-403e-9f6f-46d32f76e4ee', 'volume_size': 1} Jul 08 14:54:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:41 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-b3088b95-5b69-4485-8d64-59ae15ae00d8 tempest-CreateVolumesFromSnapshotTest-989353771 None] Created reservations ['ccbc2088-5eca-4b2a-84d1-ffce77e9f8cb', 'd032bb90-b1a5-44fb-b67b-2ea4e0acd475', '8ba3b6ae-deda-4f71-9277-6f0bbbfa82e1', 'be3748e8-d29c-45a1-b793-a663317e785f'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b3088b95-5b69-4485-8d64-59ae15ae00d8 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b3088b95-5b69-4485-8d64-59ae15ae00d8 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b3088b95-5b69-4485-8d64-59ae15ae00d8 tempest-CreateVolumesFromSnapshotTest-989353771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b3088b95-5b69-4485-8d64-59ae15ae00d8 tempest-CreateVolumesFromSnapshotTest-989353771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b3088b95-5b69-4485-8d64-59ae15ae00d8 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b3088b95-5b69-4485-8d64-59ae15ae00d8 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:42 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:54:42 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ccc622da-54ef-437e-ae0d-1dd5251dbc2b tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "cinder-c3ce0137-8138-48a5-8e17-5b6e3f3d51bc-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ccc622da-54ef-437e-ae0d-1dd5251dbc2b tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-c3ce0137-8138-48a5-8e17-5b6e3f3d51bc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ccc622da-54ef-437e-ae0d-1dd5251dbc2b tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "cinder-quobyte-c3ce0137-8138-48a5-8e17-5b6e3f3d51bc" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ccc622da-54ef-437e-ae0d-1dd5251dbc2b tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-quobyte-c3ce0137-8138-48a5-8e17-5b6e3f3d51bc" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:42 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78dea40-59ff-445b-9911-3b870d5d455f]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccc622da-54ef-437e-ae0d-1dd5251dbc2b tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c3ce0137-8138-48a5-8e17-5b6e3f3d51bc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:42 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-da9b73f2-20c7-4043-978c-77d81037a6c5 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.f4274da2-a2f9-4b2f-b9cd-1e303ad3561c" returned: 0 in 0.654s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:42 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c3ce0137-8138-48a5-8e17-5b6e3f3d51bc Jul 08 14:54:42 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-da9b73f2-20c7-4043-978c-77d81037a6c5 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:42 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.info Jul 08 14:54:42 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:42 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b3088b95-5b69-4485-8d64-59ae15ae00d8 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.735s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:42 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-b3088b95-5b69-4485-8d64-59ae15ae00d8 tempest-CreateVolumesFromSnapshotTest-989353771 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b3088b95-5b69-4485-8d64-59ae15ae00d8 tempest-CreateVolumesFromSnapshotTest-989353771 None] Deleted volume successfully. Jul 08 14:54:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b3088b95-5b69-4485-8d64-59ae15ae00d8 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-e3ab53dd-0d88-49e0-ad8a-3ccb0a5151b1-delete_volume" released by "delete_volume" :: held 2.787s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:43 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccc622da-54ef-437e-ae0d-1dd5251dbc2b tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c3ce0137-8138-48a5-8e17-5b6e3f3d51bc" returned: 0 in 0.785s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccc622da-54ef-437e-ae0d-1dd5251dbc2b tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c3ce0137-8138-48a5-8e17-5b6e3f3d51bc {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:43 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c3ce0137-8138-48a5-8e17-5b6e3f3d51bc Jul 08 14:54:43 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:43 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-da9b73f2-20c7-4043-978c-77d81037a6c5 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.info" returned: 0 in 0.693s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:43 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-da9b73f2-20c7-4043-978c-77d81037a6c5 tempest-ProjectMemberTests-737282236 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.info is being set with open permissions: ugo+rw Jul 08 14:54:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-da9b73f2-20c7-4043-978c-77d81037a6c5 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:43 devstack sudo[106970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.info Jul 08 14:54:43 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:43 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccc622da-54ef-437e-ae0d-1dd5251dbc2b tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-c3ce0137-8138-48a5-8e17-5b6e3f3d51bc" returned: 0 in 0.683s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:43 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-da9b73f2-20c7-4043-978c-77d81037a6c5 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.info" returned: 0 in 0.658s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-da9b73f2-20c7-4043-978c-77d81037a6c5 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.783s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ccc622da-54ef-437e-ae0d-1dd5251dbc2b tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-quobyte-c3ce0137-8138-48a5-8e17-5b6e3f3d51bc" released by "delete_volume" :: held 1.535s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f1475971-8784-45e9-a0ae-d88fd6da1e82 tempest-SnapshotDependencyTests-1617129267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.565s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f1475971-8784-45e9-a0ae-d88fd6da1e82 tempest-SnapshotDependencyTests-1617129267 None] Creating offline snapshot c54075a7-9189-477f-9564-2a18710980fb of volume f8938422-188b-41d3-a00c-4f152eebaadd {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:54:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-da9b73f2-20c7-4043-978c-77d81037a6c5 tempest-ProjectMemberTests-737282236 None] Create snapshot completed successfully Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d12e94-3370-4c1a-ba3e-9cd1b47a4a7c]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f1475971-8784-45e9-a0ae-d88fd6da1e82 tempest-SnapshotDependencyTests-1617129267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-ccc622da-54ef-437e-ae0d-1dd5251dbc2b tempest-CreateVolumesFromSnapshotTest-989353771 None] Created reservations ['bc63de63-c21b-4caf-b800-d321a161da8e', '4025876e-74b9-4f86-a705-a409c9181338', 'a94b6123-dc12-4239-8f79-ce45023dd8f1', 'b13823eb-a531-44fe-b833-0a82f810dabf'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ccc622da-54ef-437e-ae0d-1dd5251dbc2b tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:44 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ccc622da-54ef-437e-ae0d-1dd5251dbc2b tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ccc622da-54ef-437e-ae0d-1dd5251dbc2b tempest-CreateVolumesFromSnapshotTest-989353771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:44 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ccc622da-54ef-437e-ae0d-1dd5251dbc2b tempest-CreateVolumesFromSnapshotTest-989353771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ccc622da-54ef-437e-ae0d-1dd5251dbc2b tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccc622da-54ef-437e-ae0d-1dd5251dbc2b tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:44 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:54:44 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-28ce3db9-ca4b-4ebe-89b6-f52f7bc7f5b0 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "cinder-6aea6b3d-413e-4dbd-8d82-91bcad29ca46-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-28ce3db9-ca4b-4ebe-89b6-f52f7bc7f5b0 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-6aea6b3d-413e-4dbd-8d82-91bcad29ca46-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-28ce3db9-ca4b-4ebe-89b6-f52f7bc7f5b0 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "cinder-quobyte-6aea6b3d-413e-4dbd-8d82-91bcad29ca46" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-28ce3db9-ca4b-4ebe-89b6-f52f7bc7f5b0 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-quobyte-6aea6b3d-413e-4dbd-8d82-91bcad29ca46" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[10803d46-ea9e-4d46-ac0f-9e9a6ac56822]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce3db9-ca4b-4ebe-89b6-f52f7bc7f5b0 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6aea6b3d-413e-4dbd-8d82-91bcad29ca46 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:44 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f1475971-8784-45e9-a0ae-d88fd6da1e82 tempest-SnapshotDependencyTests-1617129267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd" returned: 0 in 0.768s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f1475971-8784-45e9-a0ae-d88fd6da1e82 tempest-SnapshotDependencyTests-1617129267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.c54075a7-9189-477f-9564-2a18710980fb 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:44 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6aea6b3d-413e-4dbd-8d82-91bcad29ca46 Jul 08 14:54:44 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:44 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.c54075a7-9189-477f-9564-2a18710980fb 1G Jul 08 14:54:44 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:44 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ccc622da-54ef-437e-ae0d-1dd5251dbc2b tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.748s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-ccc622da-54ef-437e-ae0d-1dd5251dbc2b tempest-CreateVolumesFromSnapshotTest-989353771 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5403bca4-ee21-411f-b7ce-b084ba0620a7 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-f4274da2-a2f9-4b2f-b9cd-1e303ad3561c-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:44 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ccc622da-54ef-437e-ae0d-1dd5251dbc2b tempest-CreateVolumesFromSnapshotTest-989353771 None] Deleted volume successfully. Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5403bca4-ee21-411f-b7ce-b084ba0620a7 tempest-ProjectMemberTests-737282236 None] Lock "cinder-f4274da2-a2f9-4b2f-b9cd-1e303ad3561c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5403bca4-ee21-411f-b7ce-b084ba0620a7 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-0c64dbaf-1dcd-4e18-aa3f-682b9473899a" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ccc622da-54ef-437e-ae0d-1dd5251dbc2b tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-c3ce0137-8138-48a5-8e17-5b6e3f3d51bc-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5403bca4-ee21-411f-b7ce-b084ba0620a7 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-0c64dbaf-1dcd-4e18-aa3f-682b9473899a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5403bca4-ee21-411f-b7ce-b084ba0620a7 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-f4274da2-a2f9-4b2f-b9cd-1e303ad3561c" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5403bca4-ee21-411f-b7ce-b084ba0620a7 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-f4274da2-a2f9-4b2f-b9cd-1e303ad3561c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5403bca4-ee21-411f-b7ce-b084ba0620a7 tempest-ProjectMemberTests-737282236 None] Deleting offline snapshot f4274da2-a2f9-4b2f-b9cd-1e303ad3561c of volume 0c64dbaf-1dcd-4e18-aa3f-682b9473899a {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:54:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5403bca4-ee21-411f-b7ce-b084ba0620a7 tempest-ProjectMemberTests-737282236 None] snapshot_file for this snap is: volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.f4274da2-a2f9-4b2f-b9cd-1e303ad3561c {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:54:45 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7689a32-d93d-483a-949e-fbc6d8b7d2fe]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5403bca4-ee21-411f-b7ce-b084ba0620a7 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.f4274da2-a2f9-4b2f-b9cd-1e303ad3561c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:45 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.f4274da2-a2f9-4b2f-b9cd-1e303ad3561c Jul 08 14:54:45 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:45 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce3db9-ca4b-4ebe-89b6-f52f7bc7f5b0 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6aea6b3d-413e-4dbd-8d82-91bcad29ca46" returned: 0 in 0.914s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce3db9-ca4b-4ebe-89b6-f52f7bc7f5b0 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6aea6b3d-413e-4dbd-8d82-91bcad29ca46 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:45 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6aea6b3d-413e-4dbd-8d82-91bcad29ca46 Jul 08 14:54:45 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:45 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f1475971-8784-45e9-a0ae-d88fd6da1e82 tempest-SnapshotDependencyTests-1617129267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.c54075a7-9189-477f-9564-2a18710980fb 1G" returned: 0 in 0.879s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f1475971-8784-45e9-a0ae-d88fd6da1e82 tempest-SnapshotDependencyTests-1617129267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8938422-188b-41d3-a00c-4f152eebaadd -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.c54075a7-9189-477f-9564-2a18710980fb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:45 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8938422-188b-41d3-a00c-4f152eebaadd -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.c54075a7-9189-477f-9564-2a18710980fb Jul 08 14:54:45 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:45 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5403bca4-ee21-411f-b7ce-b084ba0620a7 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.f4274da2-a2f9-4b2f-b9cd-1e303ad3561c" returned: 0 in 0.812s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5403bca4-ee21-411f-b7ce-b084ba0620a7 tempest-ProjectMemberTests-737282236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:54:45 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[925283af-9a8a-424f-a648-8cb4f061aa94]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5403bca4-ee21-411f-b7ce-b084ba0620a7 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:45 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a Jul 08 14:54:45 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:46 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce3db9-ca4b-4ebe-89b6-f52f7bc7f5b0 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6aea6b3d-413e-4dbd-8d82-91bcad29ca46" returned: 0 in 0.712s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-28ce3db9-ca4b-4ebe-89b6-f52f7bc7f5b0 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-quobyte-6aea6b3d-413e-4dbd-8d82-91bcad29ca46" released by "delete_volume" :: held 1.670s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:46 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-28ce3db9-ca4b-4ebe-89b6-f52f7bc7f5b0 tempest-CreateVolumesFromSnapshotTest-989353771 None] Created reservations ['ebf1f62c-b606-499d-b7f5-d2d35ad569df', '35058817-7a73-44c7-8fb8-6dd60f3e5569', '4e7f9654-a275-40de-b7ed-489b60932cf3', '06dbbff4-2103-437c-80e5-47a2cf15fdab'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:46 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f1475971-8784-45e9-a0ae-d88fd6da1e82 tempest-SnapshotDependencyTests-1617129267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8938422-188b-41d3-a00c-4f152eebaadd -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.c54075a7-9189-477f-9564-2a18710980fb" returned: 0 in 0.708s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:46 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-f1475971-8784-45e9-a0ae-d88fd6da1e82 tempest-SnapshotDependencyTests-1617129267 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.c54075a7-9189-477f-9564-2a18710980fb is being set with open permissions: ugo+rw Jul 08 14:54:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f1475971-8784-45e9-a0ae-d88fd6da1e82 tempest-SnapshotDependencyTests-1617129267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.c54075a7-9189-477f-9564-2a18710980fb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:46 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.c54075a7-9189-477f-9564-2a18710980fb Jul 08 14:54:46 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-28ce3db9-ca4b-4ebe-89b6-f52f7bc7f5b0 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-28ce3db9-ca4b-4ebe-89b6-f52f7bc7f5b0 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-28ce3db9-ca4b-4ebe-89b6-f52f7bc7f5b0 tempest-CreateVolumesFromSnapshotTest-989353771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-28ce3db9-ca4b-4ebe-89b6-f52f7bc7f5b0 tempest-CreateVolumesFromSnapshotTest-989353771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-28ce3db9-ca4b-4ebe-89b6-f52f7bc7f5b0 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce3db9-ca4b-4ebe-89b6-f52f7bc7f5b0 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:46 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:54:46 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:46 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5403bca4-ee21-411f-b7ce-b084ba0620a7 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a" returned: 0 in 0.740s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5403bca4-ee21-411f-b7ce-b084ba0620a7 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.f4274da2-a2f9-4b2f-b9cd-1e303ad3561c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:46 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.f4274da2-a2f9-4b2f-b9cd-1e303ad3561c Jul 08 14:54:46 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b1a42cdc-1424-4e35-ad4f-2bb153b4f064 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "cinder-1ef44fd8-c44c-4779-bcac-826007eaea5d-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b1a42cdc-1424-4e35-ad4f-2bb153b4f064 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-1ef44fd8-c44c-4779-bcac-826007eaea5d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b1a42cdc-1424-4e35-ad4f-2bb153b4f064 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "cinder-quobyte-1ef44fd8-c44c-4779-bcac-826007eaea5d" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b1a42cdc-1424-4e35-ad4f-2bb153b4f064 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-quobyte-1ef44fd8-c44c-4779-bcac-826007eaea5d" acquired by "delete_volume" :: waited 0.034s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:46 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d020bd2d-762a-45d9-a158-b6dae1cef6ce]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b1a42cdc-1424-4e35-ad4f-2bb153b4f064 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ef44fd8-c44c-4779-bcac-826007eaea5d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:47 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ef44fd8-c44c-4779-bcac-826007eaea5d Jul 08 14:54:47 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:47 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f1475971-8784-45e9-a0ae-d88fd6da1e82 tempest-SnapshotDependencyTests-1617129267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.c54075a7-9189-477f-9564-2a18710980fb" returned: 0 in 0.795s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f1475971-8784-45e9-a0ae-d88fd6da1e82 tempest-SnapshotDependencyTests-1617129267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:47 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.info Jul 08 14:54:47 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:47 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-28ce3db9-ca4b-4ebe-89b6-f52f7bc7f5b0 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.813s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:47 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-28ce3db9-ca4b-4ebe-89b6-f52f7bc7f5b0 tempest-CreateVolumesFromSnapshotTest-989353771 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-28ce3db9-ca4b-4ebe-89b6-f52f7bc7f5b0 tempest-CreateVolumesFromSnapshotTest-989353771 None] Deleted volume successfully. Jul 08 14:54:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-28ce3db9-ca4b-4ebe-89b6-f52f7bc7f5b0 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-6aea6b3d-413e-4dbd-8d82-91bcad29ca46-delete_volume" released by "delete_volume" :: held 2.732s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:47 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5403bca4-ee21-411f-b7ce-b084ba0620a7 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.f4274da2-a2f9-4b2f-b9cd-1e303ad3561c" returned: 0 in 0.832s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5403bca4-ee21-411f-b7ce-b084ba0620a7 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.f4274da2-a2f9-4b2f-b9cd-1e303ad3561c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:47 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.f4274da2-a2f9-4b2f-b9cd-1e303ad3561c Jul 08 14:54:47 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:47 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b1a42cdc-1424-4e35-ad4f-2bb153b4f064 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ef44fd8-c44c-4779-bcac-826007eaea5d" returned: 0 in 0.847s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b1a42cdc-1424-4e35-ad4f-2bb153b4f064 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ef44fd8-c44c-4779-bcac-826007eaea5d {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:47 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ef44fd8-c44c-4779-bcac-826007eaea5d Jul 08 14:54:47 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:47 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f1475971-8784-45e9-a0ae-d88fd6da1e82 tempest-SnapshotDependencyTests-1617129267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.info" returned: 0 in 0.681s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:47 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-f1475971-8784-45e9-a0ae-d88fd6da1e82 tempest-SnapshotDependencyTests-1617129267 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.info is being set with open permissions: ugo+rw Jul 08 14:54:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f1475971-8784-45e9-a0ae-d88fd6da1e82 tempest-SnapshotDependencyTests-1617129267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:47 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.info Jul 08 14:54:47 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:48 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5403bca4-ee21-411f-b7ce-b084ba0620a7 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a.f4274da2-a2f9-4b2f-b9cd-1e303ad3561c" returned: 0 in 0.728s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5403bca4-ee21-411f-b7ce-b084ba0620a7 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-f4274da2-a2f9-4b2f-b9cd-1e303ad3561c" released by "_delete_snapshot" :: held 3.243s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5403bca4-ee21-411f-b7ce-b084ba0620a7 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-0c64dbaf-1dcd-4e18-aa3f-682b9473899a" released by "delete_snapshot" :: held 3.275s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-5403bca4-ee21-411f-b7ce-b084ba0620a7 tempest-ProjectMemberTests-737282236 None] Created reservations ['fe806678-5bfe-4fdd-837c-837700b82b72', '08c2de9e-8134-4b8b-b737-31643b7720b0', '6397c4f0-5859-42a4-9c44-b18bc48a981f', 'be16577c-8f30-42c6-9313-46c241318448'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:48 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5403bca4-ee21-411f-b7ce-b084ba0620a7 tempest-ProjectMemberTests-737282236 None] Delete snapshot completed successfully. Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5403bca4-ee21-411f-b7ce-b084ba0620a7 tempest-ProjectMemberTests-737282236 None] Lock "cinder-f4274da2-a2f9-4b2f-b9cd-1e303ad3561c-delete_snapshot" released by "delete_snapshot" :: held 3.443s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:48 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b1a42cdc-1424-4e35-ad4f-2bb153b4f064 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-1ef44fd8-c44c-4779-bcac-826007eaea5d" returned: 0 in 0.710s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b1a42cdc-1424-4e35-ad4f-2bb153b4f064 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-quobyte-1ef44fd8-c44c-4779-bcac-826007eaea5d" released by "delete_volume" :: held 1.617s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:48 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-b1a42cdc-1424-4e35-ad4f-2bb153b4f064 tempest-CreateVolumesFromSnapshotTest-989353771 None] Created reservations ['b6b965d1-729a-463a-81f9-d851fe2dfd72', '3b6a7f4c-2e88-4948-a01e-2d2382676b19', '7ac98a60-0f8d-4e93-90ba-d37da68d93c2', '67f8ea06-b77e-4a9f-9f75-632a5d16658b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f1475971-8784-45e9-a0ae-d88fd6da1e82 tempest-SnapshotDependencyTests-1617129267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.info" returned: 0 in 0.697s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f1475971-8784-45e9-a0ae-d88fd6da1e82 tempest-SnapshotDependencyTests-1617129267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.651s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.650s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-583844031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b38094da-b9aa-403e-9f6f-46d32f76e4ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e378f56e3f7d411d8096dbe3c116f8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:42Z,use_quota=True,user_id='0ebe803eb5a74f9994c51a28a1ece0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Creating volume b38094da-b9aa-403e-9f6f-46d32f76e4ee {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:54:48 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b38094da-b9aa-403e-9f6f-46d32f76e4ee 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:48 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b38094da-b9aa-403e-9f6f-46d32f76e4ee 1073741824 Jul 08 14:54:48 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:48 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f1475971-8784-45e9-a0ae-d88fd6da1e82 tempest-SnapshotDependencyTests-1617129267 None] Create snapshot completed successfully Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b1a42cdc-1424-4e35-ad4f-2bb153b4f064 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b1a42cdc-1424-4e35-ad4f-2bb153b4f064 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b1a42cdc-1424-4e35-ad4f-2bb153b4f064 tempest-CreateVolumesFromSnapshotTest-989353771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b1a42cdc-1424-4e35-ad4f-2bb153b4f064 tempest-CreateVolumesFromSnapshotTest-989353771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b1a42cdc-1424-4e35-ad4f-2bb153b4f064 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b1a42cdc-1424-4e35-ad4f-2bb153b4f064 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:48 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:54:48 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0666fcc7-b45a-4cdc-af91-5648a664a56b tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "cinder-59fae403-f4ea-4f8f-8195-3d2fbb1533b7-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0666fcc7-b45a-4cdc-af91-5648a664a56b tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-59fae403-f4ea-4f8f-8195-3d2fbb1533b7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0666fcc7-b45a-4cdc-af91-5648a664a56b tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "cinder-quobyte-59fae403-f4ea-4f8f-8195-3d2fbb1533b7" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0666fcc7-b45a-4cdc-af91-5648a664a56b tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-quobyte-59fae403-f4ea-4f8f-8195-3d2fbb1533b7" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:49 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ec2d6a-265d-4021-96ff-c05ab00fdee0]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0666fcc7-b45a-4cdc-af91-5648a664a56b tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59fae403-f4ea-4f8f-8195-3d2fbb1533b7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a09a5e3b-4a8a-4425-bf71-9fffbe94c14b tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-0c64dbaf-1dcd-4e18-aa3f-682b9473899a-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a09a5e3b-4a8a-4425-bf71-9fffbe94c14b tempest-ProjectMemberTests-737282236 None] Lock "cinder-0c64dbaf-1dcd-4e18-aa3f-682b9473899a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a09a5e3b-4a8a-4425-bf71-9fffbe94c14b tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-0c64dbaf-1dcd-4e18-aa3f-682b9473899a" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a09a5e3b-4a8a-4425-bf71-9fffbe94c14b tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-0c64dbaf-1dcd-4e18-aa3f-682b9473899a" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:49 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59fae403-f4ea-4f8f-8195-3d2fbb1533b7 Jul 08 14:54:49 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:49 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacfc11a-c5f7-452f-9300-a96a2c94e5bc]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a09a5e3b-4a8a-4425-bf71-9fffbe94c14b tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:49 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a Jul 08 14:54:49 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:49 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b1a42cdc-1424-4e35-ad4f-2bb153b4f064 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.995s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:49 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-b1a42cdc-1424-4e35-ad4f-2bb153b4f064 tempest-CreateVolumesFromSnapshotTest-989353771 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:49 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b38094da-b9aa-403e-9f6f-46d32f76e4ee 1073741824" returned: 0 in 1.103s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:49 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b1a42cdc-1424-4e35-ad4f-2bb153b4f064 tempest-CreateVolumesFromSnapshotTest-989353771 None] Deleted volume successfully. Jul 08 14:54:49 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b1a42cdc-1424-4e35-ad4f-2bb153b4f064 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-1ef44fd8-c44c-4779-bcac-826007eaea5d-delete_volume" released by "delete_volume" :: held 2.922s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b38094da-b9aa-403e-9f6f-46d32f76e4ee {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:49 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b38094da-b9aa-403e-9f6f-46d32f76e4ee Jul 08 14:54:49 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Flow 'volume_create_manager' (7f4cb020-d4d1-46f4-8abc-ac8f487689dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e7b1e1-269e-4f56-b87d-7abed71d3894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e7b1e1-269e-4f56-b87d-7abed71d3894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4face3-e136-446e-8bf7-98f8a8441d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='604d1f735d874951a0e8509491b0af97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c54075a7-9189-477f-9564-2a18710980fb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:50Z,use_quota=True,user_id='fc5692bcebfe4bc8a6e0377737b041b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e1795c-f3fe-4817-8317-a546aa8c5347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e1795c-f3fe-4817-8317-a546aa8c5347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf821206-5d6f-430e-a99e-b9500c41eb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf821206-5d6f-430e-a99e-b9500c41eb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9b4face3-e136-446e-8bf7-98f8a8441d49', 'volume_name': 'volume-9b4face3-e136-446e-8bf7-98f8a8441d49', 'volume_size': 1, 'snapshot_id': 'c54075a7-9189-477f-9564-2a18710980fb'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ead97bb-2062-426e-b26d-cdbfb7f7b748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ead97bb-2062-426e-b26d-cdbfb7f7b748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e588790c-5d3d-4aaa-8601-138f9ee38b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:50 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Volume 9b4face3-e136-446e-8bf7-98f8a8441d49: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9b4face3-e136-446e-8bf7-98f8a8441d49', 'volume_size': 1, 'snapshot_id': 'c54075a7-9189-477f-9564-2a18710980fb'} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:50 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0666fcc7-b45a-4cdc-af91-5648a664a56b tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59fae403-f4ea-4f8f-8195-3d2fbb1533b7" returned: 0 in 0.984s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0666fcc7-b45a-4cdc-af91-5648a664a56b tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59fae403-f4ea-4f8f-8195-3d2fbb1533b7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:50 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59fae403-f4ea-4f8f-8195-3d2fbb1533b7 Jul 08 14:54:50 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:50 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a09a5e3b-4a8a-4425-bf71-9fffbe94c14b tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a" returned: 0 in 1.003s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a09a5e3b-4a8a-4425-bf71-9fffbe94c14b tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:50 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a Jul 08 14:54:50 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:50 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b38094da-b9aa-403e-9f6f-46d32f76e4ee" returned: 0 in 0.767s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.433s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Acquiring lock "cinder-quobyte-c54075a7-9189-477f-9564-2a18710980fb-9b4face3-e136-446e-8bf7-98f8a8441d49" by "_create_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (724bd6f3-c8a5-4854-a873-79cea3973f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b38094da-b9aa-403e-9f6f-46d32f76e4ee', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b2a7cd-f654-4ca6-a440-9b9c5445e2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Lock "cinder-quobyte-c54075a7-9189-477f-9564-2a18710980fb-9b4face3-e136-446e-8bf7-98f8a8441d49" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Creating volume 9b4face3-e136-446e-8bf7-98f8a8441d49 from snapshot c54075a7-9189-477f-9564-2a18710980fb {{(pid=87240) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Acquiring lock "cinder-quobyte-9b4face3-e136-446e-8bf7-98f8a8441d49" by "_copy_volume_from_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Lock "cinder-quobyte-9b4face3-e136-446e-8bf7-98f8a8441d49" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] snapshot: c54075a7-9189-477f-9564-2a18710980fb, volume: 9b4face3-e136-446e-8bf7-98f8a8441d49, {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 14:54:50 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Volume volume-b38094da-b9aa-403e-9f6f-46d32f76e4ee (b38094da-b9aa-403e-9f6f-46d32f76e4ee): created successfully Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b2a7cd-f654-4ca6-a440-9b9c5445e2f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Flow 'volume_create_manager' (c4ab6481-3dc4-47fb-8627-97e2eac7aed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-56b4f5f7-0f4e-498e-a91b-bf0ee1ee0fbe tempest-ProjectReaderTests-1747622714 None] Created volume successfully. Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70efe0b-9ec3-4915-8b8b-76c403f70027]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.c54075a7-9189-477f-9564-2a18710980fb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:50 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.c54075a7-9189-477f-9564-2a18710980fb Jul 08 14:54:50 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:51 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0666fcc7-b45a-4cdc-af91-5648a664a56b tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-59fae403-f4ea-4f8f-8195-3d2fbb1533b7" returned: 0 in 0.778s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0666fcc7-b45a-4cdc-af91-5648a664a56b tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-quobyte-59fae403-f4ea-4f8f-8195-3d2fbb1533b7" released by "delete_volume" :: held 1.818s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-0666fcc7-b45a-4cdc-af91-5648a664a56b tempest-CreateVolumesFromSnapshotTest-989353771 None] Created reservations ['29afb49d-4707-41b1-8d43-765ed3c26de7', '56c69486-01ae-440e-bbff-edee44267d49', '61375ac8-8172-4ced-8b64-6703fdc5fae4', '066a6535-7692-4f4f-9e22-997dde3629d1'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0666fcc7-b45a-4cdc-af91-5648a664a56b tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0666fcc7-b45a-4cdc-af91-5648a664a56b tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0666fcc7-b45a-4cdc-af91-5648a664a56b tempest-CreateVolumesFromSnapshotTest-989353771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0666fcc7-b45a-4cdc-af91-5648a664a56b tempest-CreateVolumesFromSnapshotTest-989353771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0666fcc7-b45a-4cdc-af91-5648a664a56b tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0666fcc7-b45a-4cdc-af91-5648a664a56b tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:51 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:54:51 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:51 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a09a5e3b-4a8a-4425-bf71-9fffbe94c14b tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-0c64dbaf-1dcd-4e18-aa3f-682b9473899a" returned: 0 in 0.728s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a09a5e3b-4a8a-4425-bf71-9fffbe94c14b tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-0c64dbaf-1dcd-4e18-aa3f-682b9473899a" released by "delete_volume" :: held 1.820s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-a09a5e3b-4a8a-4425-bf71-9fffbe94c14b tempest-ProjectMemberTests-737282236 None] Created reservations ['4a35883f-4027-4ae6-a292-d12fc9fcf494', 'f4ee1581-ecb4-42d2-bbfd-b90c2a613f09', '2bc13ae0-ff47-4c41-a268-421c0bb62731', 'c73e1e8d-f5d2-4aca-bbc9-b0faf4ecf576'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a09a5e3b-4a8a-4425-bf71-9fffbe94c14b tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a09a5e3b-4a8a-4425-bf71-9fffbe94c14b tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a09a5e3b-4a8a-4425-bf71-9fffbe94c14b tempest-ProjectMemberTests-737282236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-a09a5e3b-4a8a-4425-bf71-9fffbe94c14b tempest-ProjectMemberTests-737282236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-a09a5e3b-4a8a-4425-bf71-9fffbe94c14b tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a09a5e3b-4a8a-4425-bf71-9fffbe94c14b tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9af15b3d-0750-4ce0-87aa-eb09f3526596 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "cinder-55422eb3-e947-4798-a46e-46820ff2a83e-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:51 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:54:51 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9af15b3d-0750-4ce0-87aa-eb09f3526596 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-55422eb3-e947-4798-a46e-46820ff2a83e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9af15b3d-0750-4ce0-87aa-eb09f3526596 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "cinder-quobyte-a9d5b301-7caa-45ac-a344-e64cf22239aa" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9af15b3d-0750-4ce0-87aa-eb09f3526596 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-quobyte-a9d5b301-7caa-45ac-a344-e64cf22239aa" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9af15b3d-0750-4ce0-87aa-eb09f3526596 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "cinder-quobyte-55422eb3-e947-4798-a46e-46820ff2a83e" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9af15b3d-0750-4ce0-87aa-eb09f3526596 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-quobyte-55422eb3-e947-4798-a46e-46820ff2a83e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9af15b3d-0750-4ce0-87aa-eb09f3526596 tempest-CreateVolumesFromSnapshotTest-989353771 None] Deleting offline snapshot 55422eb3-e947-4798-a46e-46820ff2a83e of volume a9d5b301-7caa-45ac-a344-e64cf22239aa {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9af15b3d-0750-4ce0-87aa-eb09f3526596 tempest-CreateVolumesFromSnapshotTest-989353771 None] snapshot_file for this snap is: volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.55422eb3-e947-4798-a46e-46820ff2a83e {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4962fd50-e4d2-4f73-9eaf-2392329aa3b8]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9af15b3d-0750-4ce0-87aa-eb09f3526596 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.55422eb3-e947-4798-a46e-46820ff2a83e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:51 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.c54075a7-9189-477f-9564-2a18710980fb" returned: 0 in 0.871s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8938422-188b-41d3-a00c-4f152eebaadd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Creating direct copy from snapshot {{(pid=87240) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca1d2e4-8e30-4ea5-a8ec-edcaf5a1556b]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:51 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.55422eb3-e947-4798-a46e-46820ff2a83e Jul 08 14:54:51 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:51 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd Jul 08 14:54:51 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-69a35ce2-7aaf-46b6-b7db-870ab46f6925 tempest-ProjectReaderTests-1747622714 None] Acquiring lock "cinder-b38094da-b9aa-403e-9f6f-46d32f76e4ee-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-69a35ce2-7aaf-46b6-b7db-870ab46f6925 tempest-ProjectReaderTests-1747622714 None] Lock "cinder-b38094da-b9aa-403e-9f6f-46d32f76e4ee-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-69a35ce2-7aaf-46b6-b7db-870ab46f6925 tempest-ProjectReaderTests-1747622714 None] Acquiring lock "cinder-quobyte-b38094da-b9aa-403e-9f6f-46d32f76e4ee" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-69a35ce2-7aaf-46b6-b7db-870ab46f6925 tempest-ProjectReaderTests-1747622714 None] Lock "cinder-quobyte-b38094da-b9aa-403e-9f6f-46d32f76e4ee" acquired by "delete_volume" :: waited 0.036s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[752ba8e9-e656-452c-88cb-ea71bbec5bb1]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-69a35ce2-7aaf-46b6-b7db-870ab46f6925 tempest-ProjectReaderTests-1747622714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b38094da-b9aa-403e-9f6f-46d32f76e4ee {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:52 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0666fcc7-b45a-4cdc-af91-5648a664a56b tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.117s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-0666fcc7-b45a-4cdc-af91-5648a664a56b tempest-CreateVolumesFromSnapshotTest-989353771 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:52 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0666fcc7-b45a-4cdc-af91-5648a664a56b tempest-CreateVolumesFromSnapshotTest-989353771 None] Deleted volume successfully. Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0666fcc7-b45a-4cdc-af91-5648a664a56b tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-59fae403-f4ea-4f8f-8195-3d2fbb1533b7-delete_volume" released by "delete_volume" :: held 3.227s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:52 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-a09a5e3b-4a8a-4425-bf71-9fffbe94c14b tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.001s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-a09a5e3b-4a8a-4425-bf71-9fffbe94c14b tempest-ProjectMemberTests-737282236 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:52 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-a09a5e3b-4a8a-4425-bf71-9fffbe94c14b tempest-ProjectMemberTests-737282236 None] Deleted volume successfully. Jul 08 14:54:52 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b38094da-b9aa-403e-9f6f-46d32f76e4ee Jul 08 14:54:52 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-a09a5e3b-4a8a-4425-bf71-9fffbe94c14b tempest-ProjectMemberTests-737282236 None] Lock "cinder-0c64dbaf-1dcd-4e18-aa3f-682b9473899a-delete_volume" released by "delete_volume" :: held 3.105s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Flow 'volume_create_manager' (dccac9d6-f747-4600-9d60-1bf23f17c6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40dfc697-e634-498a-b7d8-7d3f10775b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40dfc697-e634-498a-b7d8-7d3f10775b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1788411371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9768ae-a7d5-410b-8fa3-d6169641828e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f2a705845349cea974ee3355d8b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:53Z,use_quota=True,user_id='9a8e1a48636043f98dd223ab9abf06db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90bd0ce2-fd69-4143-b9f7-a12789cff008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90bd0ce2-fd69-4143-b9f7-a12789cff008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52910e3b-609b-4a79-ab02-a59b41f01a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52910e3b-609b-4a79-ab02-a59b41f01a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b9768ae-a7d5-410b-8fa3-d6169641828e', 'volume_name': 'volume-3b9768ae-a7d5-410b-8fa3-d6169641828e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b1192e5-4393-4b0c-8875-cfaa168acd67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b1192e5-4393-4b0c-8875-cfaa168acd67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d6fef5-ade0-4b34-bfd0-08ea1059f7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:52 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Volume 3b9768ae-a7d5-410b-8fa3-d6169641828e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b9768ae-a7d5-410b-8fa3-d6169641828e', 'volume_size': 1} Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:52 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9af15b3d-0750-4ce0-87aa-eb09f3526596 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.55422eb3-e947-4798-a46e-46820ff2a83e" returned: 0 in 1.192s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9af15b3d-0750-4ce0-87aa-eb09f3526596 tempest-CreateVolumesFromSnapshotTest-989353771 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9d5b301-7caa-45ac-a344-e64cf22239aa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4cf271-599a-41a4-a0bd-9800d245c215]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9af15b3d-0750-4ce0-87aa-eb09f3526596 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:52 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd" returned: 0 in 1.256s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:52 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa Jul 08 14:54:52 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG cinder.utils [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Path /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9b4face3-e136-446e-8bf7-98f8a8441d49 not found in is_blk_device check {{(pid=87240) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 14:54:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9b4face3-e136-446e-8bf7-98f8a8441d49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:52 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9b4face3-e136-446e-8bf7-98f8a8441d49 Jul 08 14:54:52 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:53 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-69a35ce2-7aaf-46b6-b7db-870ab46f6925 tempest-ProjectReaderTests-1747622714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b38094da-b9aa-403e-9f6f-46d32f76e4ee" returned: 0 in 0.997s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-69a35ce2-7aaf-46b6-b7db-870ab46f6925 tempest-ProjectReaderTests-1747622714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b38094da-b9aa-403e-9f6f-46d32f76e4ee {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:53 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b38094da-b9aa-403e-9f6f-46d32f76e4ee Jul 08 14:54:53 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:53 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9af15b3d-0750-4ce0-87aa-eb09f3526596 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa" returned: 0 in 0.927s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9af15b3d-0750-4ce0-87aa-eb09f3526596 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.55422eb3-e947-4798-a46e-46820ff2a83e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:53 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.55422eb3-e947-4798-a46e-46820ff2a83e Jul 08 14:54:53 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:54 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-69a35ce2-7aaf-46b6-b7db-870ab46f6925 tempest-ProjectReaderTests-1747622714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-b38094da-b9aa-403e-9f6f-46d32f76e4ee" returned: 0 in 0.978s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-69a35ce2-7aaf-46b6-b7db-870ab46f6925 tempest-ProjectReaderTests-1747622714 None] Lock "cinder-quobyte-b38094da-b9aa-403e-9f6f-46d32f76e4ee" released by "delete_volume" :: held 2.067s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:54 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-69a35ce2-7aaf-46b6-b7db-870ab46f6925 tempest-ProjectReaderTests-1747622714 None] Created reservations ['b993fce7-bb39-4891-8ca5-6826741863a4', '944d2fcd-b339-460e-b817-8de0d1ab5cb0', '66290540-46d6-4c9b-93f4-0de83218dcb4', 'b21a9cb2-3629-4a19-901b-7193a5351a0d'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-69a35ce2-7aaf-46b6-b7db-870ab46f6925 tempest-ProjectReaderTests-1747622714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-69a35ce2-7aaf-46b6-b7db-870ab46f6925 tempest-ProjectReaderTests-1747622714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-69a35ce2-7aaf-46b6-b7db-870ab46f6925 tempest-ProjectReaderTests-1747622714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-69a35ce2-7aaf-46b6-b7db-870ab46f6925 tempest-ProjectReaderTests-1747622714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-69a35ce2-7aaf-46b6-b7db-870ab46f6925 tempest-ProjectReaderTests-1747622714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-69a35ce2-7aaf-46b6-b7db-870ab46f6925 tempest-ProjectReaderTests-1747622714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:54 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:54:54 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:55 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9af15b3d-0750-4ce0-87aa-eb09f3526596 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.55422eb3-e947-4798-a46e-46820ff2a83e" returned: 0 in 1.858s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9af15b3d-0750-4ce0-87aa-eb09f3526596 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.55422eb3-e947-4798-a46e-46820ff2a83e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:55 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.55422eb3-e947-4798-a46e-46820ff2a83e Jul 08 14:54:55 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:56 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:54:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Flow 'volume_create_manager' (a2613e80-6c71-4765-a274-2777f417315a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:54:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23b3bef-badc-4510-a360-bcd58f54cee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:56 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-69a35ce2-7aaf-46b6-b7db-870ab46f6925 tempest-ProjectReaderTests-1747622714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 1.626s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:56 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-69a35ce2-7aaf-46b6-b7db-870ab46f6925 tempest-ProjectReaderTests-1747622714 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:54:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23b3bef-badc-4510-a360-bcd58f54cee4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-235623631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e378f56e3f7d411d8096dbe3c116f8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:56Z,use_quota=True,user_id='0ebe803eb5a74f9994c51a28a1ece0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1319e230-c9dc-437b-b14a-5ca5485d303e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1319e230-c9dc-437b-b14a-5ca5485d303e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0e40cf-64a5-47a7-a3da-fbb038b8b887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e0e40cf-64a5-47a7-a3da-fbb038b8b887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c', 'volume_name': 'volume-7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea5c403-7287-4b43-af3d-8f77cfd6fb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ea5c403-7287-4b43-af3d-8f77cfd6fb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:54:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2464b8d-d995-4440-98a4-6ee0bc570f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:54:56 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Volume 7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c', 'volume_size': 1} Jul 08 14:54:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:56 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-69a35ce2-7aaf-46b6-b7db-870ab46f6925 tempest-ProjectReaderTests-1747622714 None] Deleted volume successfully. Jul 08 14:54:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-69a35ce2-7aaf-46b6-b7db-870ab46f6925 tempest-ProjectReaderTests-1747622714 None] Lock "cinder-b38094da-b9aa-403e-9f6f-46d32f76e4ee-delete_volume" released by "delete_volume" :: held 4.429s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:56 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9af15b3d-0750-4ce0-87aa-eb09f3526596 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa.55422eb3-e947-4798-a46e-46820ff2a83e" returned: 0 in 1.110s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9af15b3d-0750-4ce0-87aa-eb09f3526596 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-quobyte-55422eb3-e947-4798-a46e-46820ff2a83e" released by "_delete_snapshot" :: held 5.308s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9af15b3d-0750-4ce0-87aa-eb09f3526596 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-quobyte-a9d5b301-7caa-45ac-a344-e64cf22239aa" released by "delete_snapshot" :: held 5.337s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:56 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-9af15b3d-0750-4ce0-87aa-eb09f3526596 tempest-CreateVolumesFromSnapshotTest-989353771 None] Created reservations ['5a4d4422-91d1-4ca9-b09e-d3972130f7b3', 'ed10546d-c651-4ee9-93c6-c0d12a406f2c', '0911ba52-1e49-4e6c-b5ec-66422c7edf90', '2efd099c-bc71-4753-aef3-a58f297f7977'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:57 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9af15b3d-0750-4ce0-87aa-eb09f3526596 tempest-CreateVolumesFromSnapshotTest-989353771 None] Delete snapshot completed successfully. Jul 08 14:54:57 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9af15b3d-0750-4ce0-87aa-eb09f3526596 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-55422eb3-e947-4798-a46e-46820ff2a83e-delete_snapshot" released by "delete_snapshot" :: held 5.701s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76c5b449-9e1f-4f9c-943c-0dbb93e68504 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "cinder-a9d5b301-7caa-45ac-a344-e64cf22239aa-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76c5b449-9e1f-4f9c-943c-0dbb93e68504 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-a9d5b301-7caa-45ac-a344-e64cf22239aa-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76c5b449-9e1f-4f9c-943c-0dbb93e68504 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "cinder-quobyte-a9d5b301-7caa-45ac-a344-e64cf22239aa" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:54:58 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76c5b449-9e1f-4f9c-943c-0dbb93e68504 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-quobyte-a9d5b301-7caa-45ac-a344-e64cf22239aa" acquired by "delete_volume" :: waited 0.029s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:54:58 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8a716f-4e8d-4155-bcb3-cee60d72b7a9]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76c5b449-9e1f-4f9c-943c-0dbb93e68504 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:58 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9b4face3-e136-446e-8bf7-98f8a8441d49" returned: 0 in 5.488s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:58 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa Jul 08 14:54:58 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:58 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[797fe01c-9fe8-409a-9a4c-0cde82f0031f]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:54:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:58 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd Jul 08 14:54:58 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:59 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76c5b449-9e1f-4f9c-943c-0dbb93e68504 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa" returned: 0 in 0.761s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76c5b449-9e1f-4f9c-943c-0dbb93e68504 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:59 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa Jul 08 14:54:59 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:54:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:59 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd" returned: 0 in 0.976s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:59 devstack cinder-volume[87240]: DEBUG cinder.image.image_utils [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Image conversion details: src /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd, size 1024.00 MB, duration 5.49 sec, destination /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9b4face3-e136-446e-8bf7-98f8a8441d49 {{(pid=87240) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 14:54:59 devstack cinder-volume[87240]: INFO cinder.image.image_utils [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Converted 1024.00 MB image at 186.42 MB/s Jul 08 14:54:59 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9b4face3-e136-446e-8bf7-98f8a8441d49 is being set with open permissions: ugo+rw Jul 08 14:54:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9b4face3-e136-446e-8bf7-98f8a8441d49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:59 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:54:59 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:59 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9b4face3-e136-446e-8bf7-98f8a8441d49 Jul 08 14:54:59 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:54:59 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jul 08 14:54:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76c5b449-9e1f-4f9c-943c-0dbb93e68504 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a9d5b301-7caa-45ac-a344-e64cf22239aa" returned: 0 in 0.639s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:54:59 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76c5b449-9e1f-4f9c-943c-0dbb93e68504 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-quobyte-a9d5b301-7caa-45ac-a344-e64cf22239aa" released by "delete_volume" :: held 1.517s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:54:59 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-76c5b449-9e1f-4f9c-943c-0dbb93e68504 tempest-CreateVolumesFromSnapshotTest-989353771 None] Created reservations ['1cd279d4-f729-4178-805a-c06a0f19af19', 'b7ab2f79-94c1-4773-ab53-35039b57f36b', '6d7dbcdc-3b02-4c93-a094-738a6cf16213', 'd88249fb-0862-4824-80f6-00d7ed84b9e7'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:54:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-76c5b449-9e1f-4f9c-943c-0dbb93e68504 tempest-CreateVolumesFromSnapshotTest-989353771 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:54:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-76c5b449-9e1f-4f9c-943c-0dbb93e68504 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:54:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-76c5b449-9e1f-4f9c-943c-0dbb93e68504 tempest-CreateVolumesFromSnapshotTest-989353771 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:54:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-76c5b449-9e1f-4f9c-943c-0dbb93e68504 tempest-CreateVolumesFromSnapshotTest-989353771 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:54:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-76c5b449-9e1f-4f9c-943c-0dbb93e68504 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:54:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76c5b449-9e1f-4f9c-943c-0dbb93e68504 tempest-CreateVolumesFromSnapshotTest-989353771 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:54:59 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:54:59 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:00 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:00 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9b4face3-e136-446e-8bf7-98f8a8441d49" returned: 0 in 0.655s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.668s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Lock "cinder-quobyte-9b4face3-e136-446e-8bf7-98f8a8441d49" released by "_copy_volume_from_snapshot" :: held 9.406s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Lock "cinder-quobyte-c54075a7-9189-477f-9564-2a18710980fb-9b4face3-e136-446e-8bf7-98f8a8441d49" released by "_create_volume_from_snapshot" :: held 9.442s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.493s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.359s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1788411371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b9768ae-a7d5-410b-8fa3-d6169641828e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f2a705845349cea974ee3355d8b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:53Z,use_quota=True,user_id='9a8e1a48636043f98dd223ab9abf06db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Creating volume 3b9768ae-a7d5-410b-8fa3-d6169641828e {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:55:00 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:00 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e 1073741824 Jul 08 14:55:00 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e588790c-5d3d-4aaa-8601-138f9ee38b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b4face3-e136-446e-8bf7-98f8a8441d49', 'volume_size': 1, 'snapshot_id': 'c54075a7-9189-477f-9564-2a18710980fb'}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536d03ad-7549-4459-8495-393f890a9a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:00 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Volume volume-9b4face3-e136-446e-8bf7-98f8a8441d49 (9b4face3-e136-446e-8bf7-98f8a8441d49): created successfully Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536d03ad-7549-4459-8495-393f890a9a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Flow 'volume_create_manager' (7f4cb020-d4d1-46f4-8abc-ac8f487689dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:00 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9bd97325-7d8c-406f-ab2c-bf7c2166154f tempest-SnapshotDependencyTests-1617129267 None] Created volume successfully. Jul 08 14:55:00 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76c5b449-9e1f-4f9c-943c-0dbb93e68504 tempest-CreateVolumesFromSnapshotTest-989353771 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.702s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-76c5b449-9e1f-4f9c-943c-0dbb93e68504 tempest-CreateVolumesFromSnapshotTest-989353771 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:55:00 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-76c5b449-9e1f-4f9c-943c-0dbb93e68504 tempest-CreateVolumesFromSnapshotTest-989353771 None] Deleted volume successfully. Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76c5b449-9e1f-4f9c-943c-0dbb93e68504 tempest-CreateVolumesFromSnapshotTest-989353771 None] Lock "cinder-a9d5b301-7caa-45ac-a344-e64cf22239aa-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:00 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e 1073741824" returned: 0 in 0.830s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=182,cinder:SELECT=143,cinder:INSERT=34,cinder:DELETE=17 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:55:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:00 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e Jul 08 14:55:00 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50828400-c826-4f39-a229-320df4cfbdba tempest-SnapshotDependencyTests-1617129267 None] Acquiring lock "cinder-c54075a7-9189-477f-9564-2a18710980fb-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50828400-c826-4f39-a229-320df4cfbdba tempest-SnapshotDependencyTests-1617129267 None] Lock "cinder-c54075a7-9189-477f-9564-2a18710980fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50828400-c826-4f39-a229-320df4cfbdba tempest-SnapshotDependencyTests-1617129267 None] Acquiring lock "cinder-quobyte-f8938422-188b-41d3-a00c-4f152eebaadd" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50828400-c826-4f39-a229-320df4cfbdba tempest-SnapshotDependencyTests-1617129267 None] Lock "cinder-quobyte-f8938422-188b-41d3-a00c-4f152eebaadd" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50828400-c826-4f39-a229-320df4cfbdba tempest-SnapshotDependencyTests-1617129267 None] Acquiring lock "cinder-quobyte-c54075a7-9189-477f-9564-2a18710980fb" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50828400-c826-4f39-a229-320df4cfbdba tempest-SnapshotDependencyTests-1617129267 None] Lock "cinder-quobyte-c54075a7-9189-477f-9564-2a18710980fb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-50828400-c826-4f39-a229-320df4cfbdba tempest-SnapshotDependencyTests-1617129267 None] Deleting offline snapshot c54075a7-9189-477f-9564-2a18710980fb of volume f8938422-188b-41d3-a00c-4f152eebaadd {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-50828400-c826-4f39-a229-320df4cfbdba tempest-SnapshotDependencyTests-1617129267 None] snapshot_file for this snap is: volume-f8938422-188b-41d3-a00c-4f152eebaadd.c54075a7-9189-477f-9564-2a18710980fb {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbc0334-f95c-42ba-b64d-96bb46569c9b]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50828400-c826-4f39-a229-320df4cfbdba tempest-SnapshotDependencyTests-1617129267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.c54075a7-9189-477f-9564-2a18710980fb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:01 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.c54075a7-9189-477f-9564-2a18710980fb Jul 08 14:55:01 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:01 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e" returned: 0 in 0.690s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.187s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:54:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-235623631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e378f56e3f7d411d8096dbe3c116f8d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:54:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:54:56Z,use_quota=True,user_id='0ebe803eb5a74f9994c51a28a1ece0a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Creating volume 7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:55:01 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39d6fef5-ade0-4b34-bfd0-08ea1059f7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b9768ae-a7d5-410b-8fa3-d6169641828e', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:01 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c 1073741824 Jul 08 14:55:01 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f5a8e7-34b4-4b6e-9a8e-0bafff5c3049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:01 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Volume volume-3b9768ae-a7d5-410b-8fa3-d6169641828e (3b9768ae-a7d5-410b-8fa3-d6169641828e): created successfully Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f5a8e7-34b4-4b6e-9a8e-0bafff5c3049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Flow 'volume_create_manager' (dccac9d6-f747-4600-9d60-1bf23f17c6db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:01 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e626ed33-3944-49ea-b1a7-66abf467f063 tempest-ProjectMemberTests-737282236 None] Created volume successfully. Jul 08 14:55:02 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50828400-c826-4f39-a229-320df4cfbdba tempest-SnapshotDependencyTests-1617129267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.c54075a7-9189-477f-9564-2a18710980fb" returned: 0 in 0.930s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-50828400-c826-4f39-a229-320df4cfbdba tempest-SnapshotDependencyTests-1617129267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8938422-188b-41d3-a00c-4f152eebaadd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:55:02 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c3fd77-36c4-4736-bb92-3400f9ddcd15]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50828400-c826-4f39-a229-320df4cfbdba tempest-SnapshotDependencyTests-1617129267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:02 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd Jul 08 14:55:02 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:02 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c 1073741824" returned: 0 in 1.143s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:02 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:DELETE=17,cinder:UPDATE=195,cinder:SELECT=137,cinder:INSERT=59 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:55:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-705fa543-50d9-4a88-99b7-426a3e77bcb5 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:02 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c Jul 08 14:55:02 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:03 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50828400-c826-4f39-a229-320df4cfbdba tempest-SnapshotDependencyTests-1617129267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd" returned: 0 in 1.002s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50828400-c826-4f39-a229-320df4cfbdba tempest-SnapshotDependencyTests-1617129267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.c54075a7-9189-477f-9564-2a18710980fb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:03 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.c54075a7-9189-477f-9564-2a18710980fb Jul 08 14:55:03 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:03 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c" returned: 0 in 0.702s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] <== create_volume: return (1929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:55:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-705fa543-50d9-4a88-99b7-426a3e77bcb5 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.704s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2464b8d-d995-4440-98a4-6ee0bc570f8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca3de3d-782f-48f8-bf1c-30179b430fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-705fa543-50d9-4a88-99b7-426a3e77bcb5 tempest-ProjectMemberTests-737282236 None] Creating offline snapshot b3c58827-c4b1-476c-9411-6f3629cbde82 of volume 3b9768ae-a7d5-410b-8fa3-d6169641828e {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:55:03 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Volume volume-7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c (7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c): created successfully Jul 08 14:55:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ca3de3d-782f-48f8-bf1c-30179b430fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:03 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Flow 'volume_create_manager' (a2613e80-6c71-4765-a274-2777f417315a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:03 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[e132c908-a09a-49b2-b05c-c3880f6bd398]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-705fa543-50d9-4a88-99b7-426a3e77bcb5 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:03 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7af4ce62-784f-4486-8063-2768a6176c5c tempest-ProjectReaderTests-1747622714 None] Created volume successfully. Jul 08 14:55:03 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e Jul 08 14:55:03 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:04 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50828400-c826-4f39-a229-320df4cfbdba tempest-SnapshotDependencyTests-1617129267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.c54075a7-9189-477f-9564-2a18710980fb" returned: 0 in 0.781s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50828400-c826-4f39-a229-320df4cfbdba tempest-SnapshotDependencyTests-1617129267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.c54075a7-9189-477f-9564-2a18710980fb {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:04 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.c54075a7-9189-477f-9564-2a18710980fb Jul 08 14:55:04 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ae31fdb5-4247-473d-be2d-6a91a4dd8fe3 tempest-ProjectReaderTests-1747622714 None] Acquiring lock "cinder-7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ae31fdb5-4247-473d-be2d-6a91a4dd8fe3 tempest-ProjectReaderTests-1747622714 None] Lock "cinder-7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ae31fdb5-4247-473d-be2d-6a91a4dd8fe3 tempest-ProjectReaderTests-1747622714 None] Acquiring lock "cinder-quobyte-7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:04 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-705fa543-50d9-4a88-99b7-426a3e77bcb5 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e" returned: 0 in 0.839s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-705fa543-50d9-4a88-99b7-426a3e77bcb5 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.b3c58827-c4b1-476c-9411-6f3629cbde82 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ae31fdb5-4247-473d-be2d-6a91a4dd8fe3 tempest-ProjectReaderTests-1747622714 None] Lock "cinder-quobyte-7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:04 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.b3c58827-c4b1-476c-9411-6f3629cbde82 1G Jul 08 14:55:04 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:04 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bc08fe-5f52-4705-ae13-8f22513eeeff]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae31fdb5-4247-473d-be2d-6a91a4dd8fe3 tempest-ProjectReaderTests-1747622714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:04 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c Jul 08 14:55:04 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:04 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-50828400-c826-4f39-a229-320df4cfbdba tempest-SnapshotDependencyTests-1617129267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd.c54075a7-9189-477f-9564-2a18710980fb" returned: 0 in 0.707s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50828400-c826-4f39-a229-320df4cfbdba tempest-SnapshotDependencyTests-1617129267 None] Lock "cinder-quobyte-c54075a7-9189-477f-9564-2a18710980fb" released by "_delete_snapshot" :: held 3.561s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50828400-c826-4f39-a229-320df4cfbdba tempest-SnapshotDependencyTests-1617129267 None] Lock "cinder-quobyte-f8938422-188b-41d3-a00c-4f152eebaadd" released by "delete_snapshot" :: held 3.591s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:04 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-50828400-c826-4f39-a229-320df4cfbdba tempest-SnapshotDependencyTests-1617129267 None] Created reservations ['5adf98a9-9af2-4509-a060-dc55c906bc68', 'fa5ef82b-48e9-4785-9ebb-21e4daabcbfd', '115d441e-c6ea-4fcd-8a3c-6129f9548351', 'dbe0a179-4e56-4e06-8f2a-a452254eddde'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:05 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-50828400-c826-4f39-a229-320df4cfbdba tempest-SnapshotDependencyTests-1617129267 None] Delete snapshot completed successfully. Jul 08 14:55:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-50828400-c826-4f39-a229-320df4cfbdba tempest-SnapshotDependencyTests-1617129267 None] Lock "cinder-c54075a7-9189-477f-9564-2a18710980fb-delete_snapshot" released by "delete_snapshot" :: held 3.755s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:05 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:05 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-705fa543-50d9-4a88-99b7-426a3e77bcb5 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.b3c58827-c4b1-476c-9411-6f3629cbde82 1G" returned: 0 in 0.884s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-705fa543-50d9-4a88-99b7-426a3e77bcb5 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b9768ae-a7d5-410b-8fa3-d6169641828e -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.b3c58827-c4b1-476c-9411-6f3629cbde82 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae31fdb5-4247-473d-be2d-6a91a4dd8fe3 tempest-ProjectReaderTests-1747622714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c" returned: 0 in 0.849s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae31fdb5-4247-473d-be2d-6a91a4dd8fe3 tempest-ProjectReaderTests-1747622714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:05 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b9768ae-a7d5-410b-8fa3-d6169641828e -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.b3c58827-c4b1-476c-9411-6f3629cbde82 Jul 08 14:55:05 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:05 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c Jul 08 14:55:05 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b75be475-dc6d-4bff-8e32-1bb392b57ea2 tempest-SnapshotDependencyTests-1617129267 None] Acquiring lock "cinder-f8938422-188b-41d3-a00c-4f152eebaadd-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b75be475-dc6d-4bff-8e32-1bb392b57ea2 tempest-SnapshotDependencyTests-1617129267 None] Lock "cinder-f8938422-188b-41d3-a00c-4f152eebaadd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b75be475-dc6d-4bff-8e32-1bb392b57ea2 tempest-SnapshotDependencyTests-1617129267 None] Acquiring lock "cinder-quobyte-f8938422-188b-41d3-a00c-4f152eebaadd" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b75be475-dc6d-4bff-8e32-1bb392b57ea2 tempest-SnapshotDependencyTests-1617129267 None] Lock "cinder-quobyte-f8938422-188b-41d3-a00c-4f152eebaadd" acquired by "delete_volume" :: waited 0.033s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:05 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7578b3e5-ee0f-4d6d-bfb2-1e4610105a90]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b75be475-dc6d-4bff-8e32-1bb392b57ea2 tempest-SnapshotDependencyTests-1617129267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:06 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd Jul 08 14:55:06 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:06 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae31fdb5-4247-473d-be2d-6a91a4dd8fe3 tempest-ProjectReaderTests-1747622714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c" returned: 0 in 0.771s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ae31fdb5-4247-473d-be2d-6a91a4dd8fe3 tempest-ProjectReaderTests-1747622714 None] Lock "cinder-quobyte-7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c" released by "delete_volume" :: held 1.671s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:06 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-ae31fdb5-4247-473d-be2d-6a91a4dd8fe3 tempest-ProjectReaderTests-1747622714 None] Created reservations ['53c1b2b8-7e70-4134-9d41-971f2fa2520c', '0d679ea1-3897-42b1-8b32-170dceb2608c', '25f0bc4f-888a-47d3-b7cb-25dca000b4bd', '36ae8cea-b442-443b-b357-1d2a111e99b5'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:06 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-705fa543-50d9-4a88-99b7-426a3e77bcb5 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3b9768ae-a7d5-410b-8fa3-d6169641828e -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.b3c58827-c4b1-476c-9411-6f3629cbde82" returned: 0 in 0.860s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:06 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-705fa543-50d9-4a88-99b7-426a3e77bcb5 tempest-ProjectMemberTests-737282236 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.b3c58827-c4b1-476c-9411-6f3629cbde82 is being set with open permissions: ugo+rw Jul 08 14:55:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-705fa543-50d9-4a88-99b7-426a3e77bcb5 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.b3c58827-c4b1-476c-9411-6f3629cbde82 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:06 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.b3c58827-c4b1-476c-9411-6f3629cbde82 Jul 08 14:55:06 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ae31fdb5-4247-473d-be2d-6a91a4dd8fe3 tempest-ProjectReaderTests-1747622714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ae31fdb5-4247-473d-be2d-6a91a4dd8fe3 tempest-ProjectReaderTests-1747622714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ae31fdb5-4247-473d-be2d-6a91a4dd8fe3 tempest-ProjectReaderTests-1747622714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ae31fdb5-4247-473d-be2d-6a91a4dd8fe3 tempest-ProjectReaderTests-1747622714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ae31fdb5-4247-473d-be2d-6a91a4dd8fe3 tempest-ProjectReaderTests-1747622714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae31fdb5-4247-473d-be2d-6a91a4dd8fe3 tempest-ProjectReaderTests-1747622714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:06 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:55:06 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:06 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b75be475-dc6d-4bff-8e32-1bb392b57ea2 tempest-SnapshotDependencyTests-1617129267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd" returned: 0 in 0.863s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b75be475-dc6d-4bff-8e32-1bb392b57ea2 tempest-SnapshotDependencyTests-1617129267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:06 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd Jul 08 14:55:06 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:07 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-705fa543-50d9-4a88-99b7-426a3e77bcb5 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.b3c58827-c4b1-476c-9411-6f3629cbde82" returned: 0 in 0.810s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-705fa543-50d9-4a88-99b7-426a3e77bcb5 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:07 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae31fdb5-4247-473d-be2d-6a91a4dd8fe3 tempest-ProjectReaderTests-1747622714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.797s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:07 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-ae31fdb5-4247-473d-be2d-6a91a4dd8fe3 tempest-ProjectReaderTests-1747622714 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:55:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ae31fdb5-4247-473d-be2d-6a91a4dd8fe3 tempest-ProjectReaderTests-1747622714 None] Deleted volume successfully. Jul 08 14:55:07 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.info Jul 08 14:55:07 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ae31fdb5-4247-473d-be2d-6a91a4dd8fe3 tempest-ProjectReaderTests-1747622714 None] Lock "cinder-7f6216c3-9271-47e2-bbbc-de7c1c4c8b5c-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:07 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b75be475-dc6d-4bff-8e32-1bb392b57ea2 tempest-SnapshotDependencyTests-1617129267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8938422-188b-41d3-a00c-4f152eebaadd" returned: 0 in 0.954s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b75be475-dc6d-4bff-8e32-1bb392b57ea2 tempest-SnapshotDependencyTests-1617129267 None] Lock "cinder-quobyte-f8938422-188b-41d3-a00c-4f152eebaadd" released by "delete_volume" :: held 1.938s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:07 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-b75be475-dc6d-4bff-8e32-1bb392b57ea2 tempest-SnapshotDependencyTests-1617129267 None] Created reservations ['7df9d53c-ccd1-44e6-90f5-486cbc5b9236', '38cefb11-aba9-4e99-84fc-82d1df85b4b2', '3b16b3e4-66b6-40de-8c2d-25677252d445', '67bc7b82-aff0-478b-9aea-60d040195974'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b75be475-dc6d-4bff-8e32-1bb392b57ea2 tempest-SnapshotDependencyTests-1617129267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b75be475-dc6d-4bff-8e32-1bb392b57ea2 tempest-SnapshotDependencyTests-1617129267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b75be475-dc6d-4bff-8e32-1bb392b57ea2 tempest-SnapshotDependencyTests-1617129267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:07 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-b75be475-dc6d-4bff-8e32-1bb392b57ea2 tempest-SnapshotDependencyTests-1617129267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b75be475-dc6d-4bff-8e32-1bb392b57ea2 tempest-SnapshotDependencyTests-1617129267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b75be475-dc6d-4bff-8e32-1bb392b57ea2 tempest-SnapshotDependencyTests-1617129267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:08 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:55:08 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:08 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-705fa543-50d9-4a88-99b7-426a3e77bcb5 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.info" returned: 0 in 1.006s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:08 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-705fa543-50d9-4a88-99b7-426a3e77bcb5 tempest-ProjectMemberTests-737282236 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.info is being set with open permissions: ugo+rw Jul 08 14:55:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-705fa543-50d9-4a88-99b7-426a3e77bcb5 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:08 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.info Jul 08 14:55:08 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:08 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b75be475-dc6d-4bff-8e32-1bb392b57ea2 tempest-SnapshotDependencyTests-1617129267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.766s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:08 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-b75be475-dc6d-4bff-8e32-1bb392b57ea2 tempest-SnapshotDependencyTests-1617129267 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:55:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b75be475-dc6d-4bff-8e32-1bb392b57ea2 tempest-SnapshotDependencyTests-1617129267 None] Deleted volume successfully. Jul 08 14:55:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-b75be475-dc6d-4bff-8e32-1bb392b57ea2 tempest-SnapshotDependencyTests-1617129267 None] Lock "cinder-f8938422-188b-41d3-a00c-4f152eebaadd-delete_volume" released by "delete_volume" :: held 3.099s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:08 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-705fa543-50d9-4a88-99b7-426a3e77bcb5 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.info" returned: 0 in 0.711s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-705fa543-50d9-4a88-99b7-426a3e77bcb5 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.266s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-705fa543-50d9-4a88-99b7-426a3e77bcb5 tempest-ProjectMemberTests-737282236 None] Create snapshot completed successfully Jul 08 14:55:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-45be254f-f4b2-4d1b-b3af-cd1720412ec4 tempest-SnapshotDependencyTests-1617129267 None] Acquiring lock "cinder-9b4face3-e136-446e-8bf7-98f8a8441d49-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-45be254f-f4b2-4d1b-b3af-cd1720412ec4 tempest-SnapshotDependencyTests-1617129267 None] Lock "cinder-9b4face3-e136-446e-8bf7-98f8a8441d49-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-45be254f-f4b2-4d1b-b3af-cd1720412ec4 tempest-SnapshotDependencyTests-1617129267 None] Acquiring lock "cinder-quobyte-9b4face3-e136-446e-8bf7-98f8a8441d49" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-45be254f-f4b2-4d1b-b3af-cd1720412ec4 tempest-SnapshotDependencyTests-1617129267 None] Lock "cinder-quobyte-9b4face3-e136-446e-8bf7-98f8a8441d49" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:09 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[10048921-f266-4960-8312-1835957bf382]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-45be254f-f4b2-4d1b-b3af-cd1720412ec4 tempest-SnapshotDependencyTests-1617129267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9b4face3-e136-446e-8bf7-98f8a8441d49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e41b84e3-1458-4e21-9a17-38797ea70260 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-b3c58827-c4b1-476c-9411-6f3629cbde82-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e41b84e3-1458-4e21-9a17-38797ea70260 tempest-ProjectMemberTests-737282236 None] Lock "cinder-b3c58827-c4b1-476c-9411-6f3629cbde82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e41b84e3-1458-4e21-9a17-38797ea70260 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-3b9768ae-a7d5-410b-8fa3-d6169641828e" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e41b84e3-1458-4e21-9a17-38797ea70260 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-3b9768ae-a7d5-410b-8fa3-d6169641828e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e41b84e3-1458-4e21-9a17-38797ea70260 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-b3c58827-c4b1-476c-9411-6f3629cbde82" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e41b84e3-1458-4e21-9a17-38797ea70260 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-b3c58827-c4b1-476c-9411-6f3629cbde82" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e41b84e3-1458-4e21-9a17-38797ea70260 tempest-ProjectMemberTests-737282236 None] Deleting offline snapshot b3c58827-c4b1-476c-9411-6f3629cbde82 of volume 3b9768ae-a7d5-410b-8fa3-d6169641828e {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:55:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e41b84e3-1458-4e21-9a17-38797ea70260 tempest-ProjectMemberTests-737282236 None] snapshot_file for this snap is: volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.b3c58827-c4b1-476c-9411-6f3629cbde82 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:55:09 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08c0572-4a8c-4a57-9cac-61860fdaabc0]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e41b84e3-1458-4e21-9a17-38797ea70260 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.b3c58827-c4b1-476c-9411-6f3629cbde82 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:09 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9b4face3-e136-446e-8bf7-98f8a8441d49 Jul 08 14:55:09 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:09 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.b3c58827-c4b1-476c-9411-6f3629cbde82 Jul 08 14:55:09 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:10 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-45be254f-f4b2-4d1b-b3af-cd1720412ec4 tempest-SnapshotDependencyTests-1617129267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9b4face3-e136-446e-8bf7-98f8a8441d49" returned: 0 in 0.918s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-45be254f-f4b2-4d1b-b3af-cd1720412ec4 tempest-SnapshotDependencyTests-1617129267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9b4face3-e136-446e-8bf7-98f8a8441d49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:10 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9b4face3-e136-446e-8bf7-98f8a8441d49 Jul 08 14:55:10 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:10 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e41b84e3-1458-4e21-9a17-38797ea70260 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.b3c58827-c4b1-476c-9411-6f3629cbde82" returned: 0 in 0.913s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-e41b84e3-1458-4e21-9a17-38797ea70260 tempest-ProjectMemberTests-737282236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3b9768ae-a7d5-410b-8fa3-d6169641828e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:55:10 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[df336431-5292-4b25-b9d7-cd10442ad402]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e41b84e3-1458-4e21-9a17-38797ea70260 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:10 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e Jul 08 14:55:10 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:10 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-45be254f-f4b2-4d1b-b3af-cd1720412ec4 tempest-SnapshotDependencyTests-1617129267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-9b4face3-e136-446e-8bf7-98f8a8441d49" returned: 0 in 0.801s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-45be254f-f4b2-4d1b-b3af-cd1720412ec4 tempest-SnapshotDependencyTests-1617129267 None] Lock "cinder-quobyte-9b4face3-e136-446e-8bf7-98f8a8441d49" released by "delete_volume" :: held 1.774s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:11 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-45be254f-f4b2-4d1b-b3af-cd1720412ec4 tempest-SnapshotDependencyTests-1617129267 None] Created reservations ['4221266a-aba2-49f9-a9d4-bf8d3ddf318f', '7e35f4fc-d04c-4474-aeb8-c9ceb525be21', 'd6a27456-f1b5-472c-8ab9-072469dce290', '0c150e36-8b67-42b0-8261-90a6b844f747'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-45be254f-f4b2-4d1b-b3af-cd1720412ec4 tempest-SnapshotDependencyTests-1617129267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-45be254f-f4b2-4d1b-b3af-cd1720412ec4 tempest-SnapshotDependencyTests-1617129267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-45be254f-f4b2-4d1b-b3af-cd1720412ec4 tempest-SnapshotDependencyTests-1617129267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-45be254f-f4b2-4d1b-b3af-cd1720412ec4 tempest-SnapshotDependencyTests-1617129267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-45be254f-f4b2-4d1b-b3af-cd1720412ec4 tempest-SnapshotDependencyTests-1617129267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-45be254f-f4b2-4d1b-b3af-cd1720412ec4 tempest-SnapshotDependencyTests-1617129267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:11 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:55:11 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:11 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e41b84e3-1458-4e21-9a17-38797ea70260 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e" returned: 0 in 0.885s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e41b84e3-1458-4e21-9a17-38797ea70260 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.b3c58827-c4b1-476c-9411-6f3629cbde82 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:11 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.b3c58827-c4b1-476c-9411-6f3629cbde82 Jul 08 14:55:11 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:11 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-45be254f-f4b2-4d1b-b3af-cd1720412ec4 tempest-SnapshotDependencyTests-1617129267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.776s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:11 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-45be254f-f4b2-4d1b-b3af-cd1720412ec4 tempest-SnapshotDependencyTests-1617129267 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:55:11 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-45be254f-f4b2-4d1b-b3af-cd1720412ec4 tempest-SnapshotDependencyTests-1617129267 None] Deleted volume successfully. Jul 08 14:55:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-45be254f-f4b2-4d1b-b3af-cd1720412ec4 tempest-SnapshotDependencyTests-1617129267 None] Lock "cinder-9b4face3-e136-446e-8bf7-98f8a8441d49-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:12 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e41b84e3-1458-4e21-9a17-38797ea70260 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.b3c58827-c4b1-476c-9411-6f3629cbde82" returned: 0 in 0.899s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e41b84e3-1458-4e21-9a17-38797ea70260 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.b3c58827-c4b1-476c-9411-6f3629cbde82 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:12 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.b3c58827-c4b1-476c-9411-6f3629cbde82 Jul 08 14:55:12 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:12 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-e41b84e3-1458-4e21-9a17-38797ea70260 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e.b3c58827-c4b1-476c-9411-6f3629cbde82" returned: 0 in 0.763s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e41b84e3-1458-4e21-9a17-38797ea70260 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-b3c58827-c4b1-476c-9411-6f3629cbde82" released by "_delete_snapshot" :: held 3.601s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e41b84e3-1458-4e21-9a17-38797ea70260 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-3b9768ae-a7d5-410b-8fa3-d6169641828e" released by "delete_snapshot" :: held 3.627s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:12 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-e41b84e3-1458-4e21-9a17-38797ea70260 tempest-ProjectMemberTests-737282236 None] Created reservations ['2c7a177b-e2f6-4af1-b28e-b4eb0270304d', 'a766d46f-da5d-49a9-b2d5-9e6ff5576526', 'f6822008-5dbb-4507-a5d6-ff5e5d9d38b2', 'f4a5b471-4e11-4a86-bb06-7f8e80bf540a'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:13 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-e41b84e3-1458-4e21-9a17-38797ea70260 tempest-ProjectMemberTests-737282236 None] Delete snapshot completed successfully. Jul 08 14:55:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-e41b84e3-1458-4e21-9a17-38797ea70260 tempest-ProjectMemberTests-737282236 None] Lock "cinder-b3c58827-c4b1-476c-9411-6f3629cbde82-delete_snapshot" released by "delete_snapshot" :: held 3.803s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2ea00397-473b-40f9-96bb-bded47d08d64 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-3b9768ae-a7d5-410b-8fa3-d6169641828e-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2ea00397-473b-40f9-96bb-bded47d08d64 tempest-ProjectMemberTests-737282236 None] Lock "cinder-3b9768ae-a7d5-410b-8fa3-d6169641828e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2ea00397-473b-40f9-96bb-bded47d08d64 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-3b9768ae-a7d5-410b-8fa3-d6169641828e" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2ea00397-473b-40f9-96bb-bded47d08d64 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-3b9768ae-a7d5-410b-8fa3-d6169641828e" acquired by "delete_volume" :: waited 0.025s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:13 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6203efc9-30d4-4822-8de0-d116d90b61b5]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2ea00397-473b-40f9-96bb-bded47d08d64 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:13 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e Jul 08 14:55:13 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:14 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2ea00397-473b-40f9-96bb-bded47d08d64 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e" returned: 0 in 0.806s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2ea00397-473b-40f9-96bb-bded47d08d64 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:14 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e Jul 08 14:55:14 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:15 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2ea00397-473b-40f9-96bb-bded47d08d64 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-3b9768ae-a7d5-410b-8fa3-d6169641828e" returned: 0 in 0.779s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:15 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2ea00397-473b-40f9-96bb-bded47d08d64 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-3b9768ae-a7d5-410b-8fa3-d6169641828e" released by "delete_volume" :: held 1.663s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:15 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-2ea00397-473b-40f9-96bb-bded47d08d64 tempest-ProjectMemberTests-737282236 None] Created reservations ['576e80e4-4a6e-4112-9f01-cc0fa2481367', '566356e2-723f-4dac-bbb6-97a3aedd6312', '0a4b76a8-3e1a-454a-9ad4-9c74eae1cbaa', '81a2c739-25b1-4b75-b052-65272f9262e2'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2ea00397-473b-40f9-96bb-bded47d08d64 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2ea00397-473b-40f9-96bb-bded47d08d64 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2ea00397-473b-40f9-96bb-bded47d08d64 tempest-ProjectMemberTests-737282236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-2ea00397-473b-40f9-96bb-bded47d08d64 tempest-ProjectMemberTests-737282236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-2ea00397-473b-40f9-96bb-bded47d08d64 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2ea00397-473b-40f9-96bb-bded47d08d64 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:15 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:55:15 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:16 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Flow 'volume_create_manager' (069b1f3c-d850-40d0-bb77-673fa3d0985f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b139b7f-1236-4709-9644-d50c6ea96f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-2ea00397-473b-40f9-96bb-bded47d08d64 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.939s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-2ea00397-473b-40f9-96bb-bded47d08d64 tempest-ProjectMemberTests-737282236 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:55:16 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-2ea00397-473b-40f9-96bb-bded47d08d64 tempest-ProjectMemberTests-737282236 None] Deleted volume successfully. Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b139b7f-1236-4709-9644-d50c6ea96f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1260190839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89430ad-ac41-499a-896d-b0625d9ec164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f2a705845349cea974ee3355d8b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:55:16Z,use_quota=True,user_id='9a8e1a48636043f98dd223ab9abf06db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d88ff78-8c6e-4aa9-bb57-26b719cb215a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d88ff78-8c6e-4aa9-bb57-26b719cb215a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744bed46-a694-433c-b65f-30c7439e5108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (744bed46-a694-433c-b65f-30c7439e5108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e89430ad-ac41-499a-896d-b0625d9ec164', 'volume_name': 'volume-e89430ad-ac41-499a-896d-b0625d9ec164', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b62778-0cd0-4dba-b96a-0f06561d6ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89b62778-0cd0-4dba-b96a-0f06561d6ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (913bd742-d4ca-4bd9-9c59-dec9f315c494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:16 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Volume e89430ad-ac41-499a-896d-b0625d9ec164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e89430ad-ac41-499a-896d-b0625d9ec164', 'volume_size': 1} Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:55:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1260190839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89430ad-ac41-499a-896d-b0625d9ec164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f2a705845349cea974ee3355d8b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:55:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:55:16Z,use_quota=True,user_id='9a8e1a48636043f98dd223ab9abf06db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Creating volume e89430ad-ac41-499a-896d-b0625d9ec164 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:55:16 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:16 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164 1073741824 Jul 08 14:55:16 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-2ea00397-473b-40f9-96bb-bded47d08d64 tempest-ProjectMemberTests-737282236 None] Lock "cinder-3b9768ae-a7d5-410b-8fa3-d6169641828e-delete_volume" released by "delete_volume" :: held 2.932s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:17 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164 1073741824" returned: 0 in 1.002s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:17 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164 Jul 08 14:55:17 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:18 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164" returned: 0 in 0.689s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:55:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (913bd742-d4ca-4bd9-9c59-dec9f315c494) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e89430ad-ac41-499a-896d-b0625d9ec164', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26cefecb-cc8a-4033-a8b9-139fe12bac85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:18 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Volume volume-e89430ad-ac41-499a-896d-b0625d9ec164 (e89430ad-ac41-499a-896d-b0625d9ec164): created successfully Jul 08 14:55:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26cefecb-cc8a-4033-a8b9-139fe12bac85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:18 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Flow 'volume_create_manager' (069b1f3c-d850-40d0-bb77-673fa3d0985f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:18 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f95dd142-b04e-42c5-b6b1-b3b0040fcad4 tempest-ProjectMemberTests-737282236 None] Created volume successfully. Jul 08 14:55:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b31b9545-58b6-470c-886e-5166aad52eb4 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b31b9545-58b6-470c-886e-5166aad52eb4 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-b31b9545-58b6-470c-886e-5166aad52eb4 tempest-ProjectMemberTests-737282236 None] Creating offline snapshot 3ac99192-a2e8-4d16-b4e6-cd0800737288 of volume e89430ad-ac41-499a-896d-b0625d9ec164 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:55:18 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[604b037f-e25e-4554-ade7-a24106166195]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b31b9545-58b6-470c-886e-5166aad52eb4 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:18 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164 Jul 08 14:55:18 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:19 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b31b9545-58b6-470c-886e-5166aad52eb4 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164" returned: 0 in 0.959s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b31b9545-58b6-470c-886e-5166aad52eb4 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.3ac99192-a2e8-4d16-b4e6-cd0800737288 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:19 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.3ac99192-a2e8-4d16-b4e6-cd0800737288 1G Jul 08 14:55:19 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:20 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b31b9545-58b6-470c-886e-5166aad52eb4 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.3ac99192-a2e8-4d16-b4e6-cd0800737288 1G" returned: 0 in 0.863s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b31b9545-58b6-470c-886e-5166aad52eb4 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e89430ad-ac41-499a-896d-b0625d9ec164 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.3ac99192-a2e8-4d16-b4e6-cd0800737288 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:20 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e89430ad-ac41-499a-896d-b0625d9ec164 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.3ac99192-a2e8-4d16-b4e6-cd0800737288 Jul 08 14:55:20 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:21 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b31b9545-58b6-470c-886e-5166aad52eb4 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e89430ad-ac41-499a-896d-b0625d9ec164 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.3ac99192-a2e8-4d16-b4e6-cd0800737288" returned: 0 in 0.729s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:21 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-b31b9545-58b6-470c-886e-5166aad52eb4 tempest-ProjectMemberTests-737282236 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.3ac99192-a2e8-4d16-b4e6-cd0800737288 is being set with open permissions: ugo+rw Jul 08 14:55:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b31b9545-58b6-470c-886e-5166aad52eb4 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.3ac99192-a2e8-4d16-b4e6-cd0800737288 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:21 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.3ac99192-a2e8-4d16-b4e6-cd0800737288 Jul 08 14:55:21 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:22 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b31b9545-58b6-470c-886e-5166aad52eb4 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.3ac99192-a2e8-4d16-b4e6-cd0800737288" returned: 0 in 0.696s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b31b9545-58b6-470c-886e-5166aad52eb4 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:22 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.info Jul 08 14:55:22 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:22 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b31b9545-58b6-470c-886e-5166aad52eb4 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.info" returned: 0 in 0.659s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:22 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-b31b9545-58b6-470c-886e-5166aad52eb4 tempest-ProjectMemberTests-737282236 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.info is being set with open permissions: ugo+rw Jul 08 14:55:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b31b9545-58b6-470c-886e-5166aad52eb4 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:22 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.info Jul 08 14:55:22 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:23 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-b31b9545-58b6-470c-886e-5166aad52eb4 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.info" returned: 0 in 0.653s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-b31b9545-58b6-470c-886e-5166aad52eb4 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.655s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:23 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-b31b9545-58b6-470c-886e-5166aad52eb4 tempest-ProjectMemberTests-737282236 None] Create snapshot completed successfully Jul 08 14:55:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8c69a285-b92d-4e2e-bd06-03f4f1defbf5 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-3ac99192-a2e8-4d16-b4e6-cd0800737288-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8c69a285-b92d-4e2e-bd06-03f4f1defbf5 tempest-ProjectMemberTests-737282236 None] Lock "cinder-3ac99192-a2e8-4d16-b4e6-cd0800737288-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8c69a285-b92d-4e2e-bd06-03f4f1defbf5 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-e89430ad-ac41-499a-896d-b0625d9ec164" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8c69a285-b92d-4e2e-bd06-03f4f1defbf5 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-e89430ad-ac41-499a-896d-b0625d9ec164" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8c69a285-b92d-4e2e-bd06-03f4f1defbf5 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-3ac99192-a2e8-4d16-b4e6-cd0800737288" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:23 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8c69a285-b92d-4e2e-bd06-03f4f1defbf5 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-3ac99192-a2e8-4d16-b4e6-cd0800737288" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8c69a285-b92d-4e2e-bd06-03f4f1defbf5 tempest-ProjectMemberTests-737282236 None] Deleting offline snapshot 3ac99192-a2e8-4d16-b4e6-cd0800737288 of volume e89430ad-ac41-499a-896d-b0625d9ec164 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:55:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8c69a285-b92d-4e2e-bd06-03f4f1defbf5 tempest-ProjectMemberTests-737282236 None] snapshot_file for this snap is: volume-e89430ad-ac41-499a-896d-b0625d9ec164.3ac99192-a2e8-4d16-b4e6-cd0800737288 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:55:23 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50184ba-977f-4b6a-bcf3-c8d3b226f908]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c69a285-b92d-4e2e-bd06-03f4f1defbf5 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.3ac99192-a2e8-4d16-b4e6-cd0800737288 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:24 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.3ac99192-a2e8-4d16-b4e6-cd0800737288 Jul 08 14:55:24 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:24 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c69a285-b92d-4e2e-bd06-03f4f1defbf5 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.3ac99192-a2e8-4d16-b4e6-cd0800737288" returned: 0 in 0.727s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8c69a285-b92d-4e2e-bd06-03f4f1defbf5 tempest-ProjectMemberTests-737282236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e89430ad-ac41-499a-896d-b0625d9ec164(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:55:24 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f989ce4d-789c-4f41-a16a-ff1df549de17]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c69a285-b92d-4e2e-bd06-03f4f1defbf5 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:24 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164 Jul 08 14:55:24 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:25 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c69a285-b92d-4e2e-bd06-03f4f1defbf5 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164" returned: 0 in 0.747s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c69a285-b92d-4e2e-bd06-03f4f1defbf5 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.3ac99192-a2e8-4d16-b4e6-cd0800737288 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:25 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.3ac99192-a2e8-4d16-b4e6-cd0800737288 Jul 08 14:55:25 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:26 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c69a285-b92d-4e2e-bd06-03f4f1defbf5 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.3ac99192-a2e8-4d16-b4e6-cd0800737288" returned: 0 in 0.726s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c69a285-b92d-4e2e-bd06-03f4f1defbf5 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.3ac99192-a2e8-4d16-b4e6-cd0800737288 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:26 devstack sudo[107797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.3ac99192-a2e8-4d16-b4e6-cd0800737288 Jul 08 14:55:26 devstack sudo[107797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:26 devstack sudo[107797]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8c69a285-b92d-4e2e-bd06-03f4f1defbf5 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164.3ac99192-a2e8-4d16-b4e6-cd0800737288" returned: 0 in 0.621s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8c69a285-b92d-4e2e-bd06-03f4f1defbf5 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-3ac99192-a2e8-4d16-b4e6-cd0800737288" released by "_delete_snapshot" :: held 2.919s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8c69a285-b92d-4e2e-bd06-03f4f1defbf5 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-e89430ad-ac41-499a-896d-b0625d9ec164" released by "delete_snapshot" :: held 2.941s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:26 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-8c69a285-b92d-4e2e-bd06-03f4f1defbf5 tempest-ProjectMemberTests-737282236 None] Created reservations ['9cf2659d-fec1-40cb-940c-e9024ac8290c', '7d83ead7-19be-4a2f-a0d5-325b07c783fe', '69196f55-757d-4b6a-9112-99eef5432cb8', '76ce8953-b579-4fa1-9dc8-e506b8cd5c50'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8c69a285-b92d-4e2e-bd06-03f4f1defbf5 tempest-ProjectMemberTests-737282236 None] Delete snapshot completed successfully. Jul 08 14:55:26 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-8c69a285-b92d-4e2e-bd06-03f4f1defbf5 tempest-ProjectMemberTests-737282236 None] Lock "cinder-3ac99192-a2e8-4d16-b4e6-cd0800737288-delete_snapshot" released by "delete_snapshot" :: held 3.074s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c84bc26f-caf7-43c8-9ad8-b2455f5a2162 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-e89430ad-ac41-499a-896d-b0625d9ec164-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c84bc26f-caf7-43c8-9ad8-b2455f5a2162 tempest-ProjectMemberTests-737282236 None] Lock "cinder-e89430ad-ac41-499a-896d-b0625d9ec164-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c84bc26f-caf7-43c8-9ad8-b2455f5a2162 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-e89430ad-ac41-499a-896d-b0625d9ec164" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:27 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c84bc26f-caf7-43c8-9ad8-b2455f5a2162 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-e89430ad-ac41-499a-896d-b0625d9ec164" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:27 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[84422ab3-05b6-42aa-9df9-60b85c0e1085]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c84bc26f-caf7-43c8-9ad8-b2455f5a2162 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:27 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164 Jul 08 14:55:27 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:27 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c84bc26f-caf7-43c8-9ad8-b2455f5a2162 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164" returned: 0 in 0.725s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c84bc26f-caf7-43c8-9ad8-b2455f5a2162 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:27 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164 Jul 08 14:55:27 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:28 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c84bc26f-caf7-43c8-9ad8-b2455f5a2162 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e89430ad-ac41-499a-896d-b0625d9ec164" returned: 0 in 0.631s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:28 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c84bc26f-caf7-43c8-9ad8-b2455f5a2162 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-e89430ad-ac41-499a-896d-b0625d9ec164" released by "delete_volume" :: held 1.412s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:28 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-c84bc26f-caf7-43c8-9ad8-b2455f5a2162 tempest-ProjectMemberTests-737282236 None] Created reservations ['85b345eb-f539-4057-bd2d-f7f1f478c98f', 'ca3ffda3-657d-46b7-be2c-eb1efe031bfb', '4e22cec1-f9f0-4f47-a1b8-f2e24e4337e4', '1af690ee-8df3-481d-b8e2-ca5f82240d90'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c84bc26f-caf7-43c8-9ad8-b2455f5a2162 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c84bc26f-caf7-43c8-9ad8-b2455f5a2162 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c84bc26f-caf7-43c8-9ad8-b2455f5a2162 tempest-ProjectMemberTests-737282236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:28 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-c84bc26f-caf7-43c8-9ad8-b2455f5a2162 tempest-ProjectMemberTests-737282236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-c84bc26f-caf7-43c8-9ad8-b2455f5a2162 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c84bc26f-caf7-43c8-9ad8-b2455f5a2162 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:28 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:55:28 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:29 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-c84bc26f-caf7-43c8-9ad8-b2455f5a2162 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.623s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-c84bc26f-caf7-43c8-9ad8-b2455f5a2162 tempest-ProjectMemberTests-737282236 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:55:29 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-c84bc26f-caf7-43c8-9ad8-b2455f5a2162 tempest-ProjectMemberTests-737282236 None] Deleted volume successfully. Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-c84bc26f-caf7-43c8-9ad8-b2455f5a2162 tempest-ProjectMemberTests-737282236 None] Lock "cinder-e89430ad-ac41-499a-896d-b0625d9ec164-delete_volume" released by "delete_volume" :: held 2.233s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Flow 'volume_create_manager' (a5b46544-3e44-4569-9bd8-3867456f8162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab85505a-fb24-4943-82d4-a16a3ba460fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab85505a-fb24-4943-82d4-a16a3ba460fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1928862754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8f4c766-0966-49d1-bf9c-d2a19e763395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f2a705845349cea974ee3355d8b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:55:30Z,use_quota=True,user_id='9a8e1a48636043f98dd223ab9abf06db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5816f7b-79b6-4725-af6c-c061f1d1a9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5816f7b-79b6-4725-af6c-c061f1d1a9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0f0d2c-4c42-4451-a3eb-b4aa4a299002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0f0d2c-4c42-4451-a3eb-b4aa4a299002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8f4c766-0966-49d1-bf9c-d2a19e763395', 'volume_name': 'volume-f8f4c766-0966-49d1-bf9c-d2a19e763395', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779df5b0-1c65-4092-bdc2-57e7c96a7678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779df5b0-1c65-4092-bdc2-57e7c96a7678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367b8199-2eac-4b68-b8ba-4e537bd949b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:29 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Volume f8f4c766-0966-49d1-bf9c-d2a19e763395: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8f4c766-0966-49d1-bf9c-d2a19e763395', 'volume_size': 1} Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:55:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1928862754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8f4c766-0966-49d1-bf9c-d2a19e763395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f2a705845349cea974ee3355d8b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:55:30Z,use_quota=True,user_id='9a8e1a48636043f98dd223ab9abf06db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Creating volume f8f4c766-0966-49d1-bf9c-d2a19e763395 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:55:29 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:55:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:29 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395 1073741824 Jul 08 14:55:29 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:30 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395 1073741824" returned: 0 in 0.857s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:30 devstack sudo[107817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395 Jul 08 14:55:30 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:31 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395" returned: 0 in 0.643s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:55:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367b8199-2eac-4b68-b8ba-4e537bd949b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8f4c766-0966-49d1-bf9c-d2a19e763395', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba2d9b71-c385-4d65-96b9-657c8775cfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:31 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Volume volume-f8f4c766-0966-49d1-bf9c-d2a19e763395 (f8f4c766-0966-49d1-bf9c-d2a19e763395): created successfully Jul 08 14:55:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba2d9b71-c385-4d65-96b9-657c8775cfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:31 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Flow 'volume_create_manager' (a5b46544-3e44-4569-9bd8-3867456f8162) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:31 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f157b290-fd60-40c3-8f0f-7157426d91ee tempest-ProjectMemberTests-737282236 None] Created volume successfully. Jul 08 14:55:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bbc78384-891c-450d-94bb-9e36361419b7 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bbc78384-891c-450d-94bb-9e36361419b7 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:31 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-bbc78384-891c-450d-94bb-9e36361419b7 tempest-ProjectMemberTests-737282236 None] Creating offline snapshot a03c77ee-cb6b-4890-9c5a-7da18111a230 of volume f8f4c766-0966-49d1-bf9c-d2a19e763395 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:55:31 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef6395a-4532-4412-9d24-d87765b57253]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbc78384-891c-450d-94bb-9e36361419b7 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:32 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395 Jul 08 14:55:32 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:32 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbc78384-891c-450d-94bb-9e36361419b7 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395" returned: 0 in 0.748s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbc78384-891c-450d-94bb-9e36361419b7 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.a03c77ee-cb6b-4890-9c5a-7da18111a230 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:32 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.a03c77ee-cb6b-4890-9c5a-7da18111a230 1G Jul 08 14:55:32 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:33 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbc78384-891c-450d-94bb-9e36361419b7 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.a03c77ee-cb6b-4890-9c5a-7da18111a230 1G" returned: 0 in 0.767s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbc78384-891c-450d-94bb-9e36361419b7 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8f4c766-0966-49d1-bf9c-d2a19e763395 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.a03c77ee-cb6b-4890-9c5a-7da18111a230 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:33 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8f4c766-0966-49d1-bf9c-d2a19e763395 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.a03c77ee-cb6b-4890-9c5a-7da18111a230 Jul 08 14:55:33 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:34 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbc78384-891c-450d-94bb-9e36361419b7 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8f4c766-0966-49d1-bf9c-d2a19e763395 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.a03c77ee-cb6b-4890-9c5a-7da18111a230" returned: 0 in 0.730s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:34 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-bbc78384-891c-450d-94bb-9e36361419b7 tempest-ProjectMemberTests-737282236 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.a03c77ee-cb6b-4890-9c5a-7da18111a230 is being set with open permissions: ugo+rw Jul 08 14:55:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbc78384-891c-450d-94bb-9e36361419b7 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.a03c77ee-cb6b-4890-9c5a-7da18111a230 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:34 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.a03c77ee-cb6b-4890-9c5a-7da18111a230 Jul 08 14:55:34 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:34 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbc78384-891c-450d-94bb-9e36361419b7 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.a03c77ee-cb6b-4890-9c5a-7da18111a230" returned: 0 in 0.685s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbc78384-891c-450d-94bb-9e36361419b7 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:34 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.info Jul 08 14:55:34 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:35 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbc78384-891c-450d-94bb-9e36361419b7 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.info" returned: 0 in 0.722s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:35 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-bbc78384-891c-450d-94bb-9e36361419b7 tempest-ProjectMemberTests-737282236 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.info is being set with open permissions: ugo+rw Jul 08 14:55:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbc78384-891c-450d-94bb-9e36361419b7 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:35 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.info Jul 08 14:55:35 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:36 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-bbc78384-891c-450d-94bb-9e36361419b7 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.info" returned: 0 in 0.677s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-bbc78384-891c-450d-94bb-9e36361419b7 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.406s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:36 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-bbc78384-891c-450d-94bb-9e36361419b7 tempest-ProjectMemberTests-737282236 None] Create snapshot completed successfully Jul 08 14:55:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3c934d46-cc1f-4ad2-93c3-c70021aedc5b tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-a03c77ee-cb6b-4890-9c5a-7da18111a230-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3c934d46-cc1f-4ad2-93c3-c70021aedc5b tempest-ProjectMemberTests-737282236 None] Lock "cinder-a03c77ee-cb6b-4890-9c5a-7da18111a230-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3c934d46-cc1f-4ad2-93c3-c70021aedc5b tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-f8f4c766-0966-49d1-bf9c-d2a19e763395" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3c934d46-cc1f-4ad2-93c3-c70021aedc5b tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-f8f4c766-0966-49d1-bf9c-d2a19e763395" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3c934d46-cc1f-4ad2-93c3-c70021aedc5b tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-a03c77ee-cb6b-4890-9c5a-7da18111a230" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3c934d46-cc1f-4ad2-93c3-c70021aedc5b tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-a03c77ee-cb6b-4890-9c5a-7da18111a230" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-3c934d46-cc1f-4ad2-93c3-c70021aedc5b tempest-ProjectMemberTests-737282236 None] Deleting offline snapshot a03c77ee-cb6b-4890-9c5a-7da18111a230 of volume f8f4c766-0966-49d1-bf9c-d2a19e763395 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:55:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-3c934d46-cc1f-4ad2-93c3-c70021aedc5b tempest-ProjectMemberTests-737282236 None] snapshot_file for this snap is: volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.a03c77ee-cb6b-4890-9c5a-7da18111a230 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:55:37 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed6495b-8ae4-49fb-8e32-d535046ee9bd]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c934d46-cc1f-4ad2-93c3-c70021aedc5b tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.a03c77ee-cb6b-4890-9c5a-7da18111a230 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:37 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.a03c77ee-cb6b-4890-9c5a-7da18111a230 Jul 08 14:55:37 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:38 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c934d46-cc1f-4ad2-93c3-c70021aedc5b tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.a03c77ee-cb6b-4890-9c5a-7da18111a230" returned: 0 in 0.755s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:38 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-3c934d46-cc1f-4ad2-93c3-c70021aedc5b tempest-ProjectMemberTests-737282236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8f4c766-0966-49d1-bf9c-d2a19e763395(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:55:38 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be5bd23-8573-4fa6-8466-a042eb951c70]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c934d46-cc1f-4ad2-93c3-c70021aedc5b tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:38 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395 Jul 08 14:55:38 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:38 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c934d46-cc1f-4ad2-93c3-c70021aedc5b tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395" returned: 0 in 0.796s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c934d46-cc1f-4ad2-93c3-c70021aedc5b tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.a03c77ee-cb6b-4890-9c5a-7da18111a230 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:38 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.a03c77ee-cb6b-4890-9c5a-7da18111a230 Jul 08 14:55:38 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:39 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c934d46-cc1f-4ad2-93c3-c70021aedc5b tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.a03c77ee-cb6b-4890-9c5a-7da18111a230" returned: 0 in 0.754s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c934d46-cc1f-4ad2-93c3-c70021aedc5b tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.a03c77ee-cb6b-4890-9c5a-7da18111a230 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:39 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.a03c77ee-cb6b-4890-9c5a-7da18111a230 Jul 08 14:55:39 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:40 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3c934d46-cc1f-4ad2-93c3-c70021aedc5b tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395.a03c77ee-cb6b-4890-9c5a-7da18111a230" returned: 0 in 0.746s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3c934d46-cc1f-4ad2-93c3-c70021aedc5b tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-a03c77ee-cb6b-4890-9c5a-7da18111a230" released by "_delete_snapshot" :: held 3.148s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3c934d46-cc1f-4ad2-93c3-c70021aedc5b tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-f8f4c766-0966-49d1-bf9c-d2a19e763395" released by "delete_snapshot" :: held 3.171s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:40 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-3c934d46-cc1f-4ad2-93c3-c70021aedc5b tempest-ProjectMemberTests-737282236 None] Created reservations ['feb2d619-88cb-4995-b932-615c6e116edf', '4e2ef3ea-1ce2-4d9b-b2ec-e310af183115', '4c3bf14a-0e90-4a82-8059-ab558b24e789', '5290f86d-84d7-4e88-a862-d3f5473c3c49'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:40 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3c934d46-cc1f-4ad2-93c3-c70021aedc5b tempest-ProjectMemberTests-737282236 None] Delete snapshot completed successfully. Jul 08 14:55:40 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3c934d46-cc1f-4ad2-93c3-c70021aedc5b tempest-ProjectMemberTests-737282236 None] Lock "cinder-a03c77ee-cb6b-4890-9c5a-7da18111a230-delete_snapshot" released by "delete_snapshot" :: held 3.296s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76abf22d-155e-41a0-b522-12231dea7a87 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-f8f4c766-0966-49d1-bf9c-d2a19e763395-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76abf22d-155e-41a0-b522-12231dea7a87 tempest-ProjectMemberTests-737282236 None] Lock "cinder-f8f4c766-0966-49d1-bf9c-d2a19e763395-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76abf22d-155e-41a0-b522-12231dea7a87 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-f8f4c766-0966-49d1-bf9c-d2a19e763395" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:41 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76abf22d-155e-41a0-b522-12231dea7a87 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-f8f4c766-0966-49d1-bf9c-d2a19e763395" acquired by "delete_volume" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:41 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5f3c6f-337f-4d58-9926-fbb958a51419]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76abf22d-155e-41a0-b522-12231dea7a87 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:41 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395 Jul 08 14:55:41 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:42 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76abf22d-155e-41a0-b522-12231dea7a87 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395" returned: 0 in 0.741s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76abf22d-155e-41a0-b522-12231dea7a87 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:42 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395 Jul 08 14:55:42 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:42 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76abf22d-155e-41a0-b522-12231dea7a87 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f8f4c766-0966-49d1-bf9c-d2a19e763395" returned: 0 in 0.614s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76abf22d-155e-41a0-b522-12231dea7a87 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-f8f4c766-0966-49d1-bf9c-d2a19e763395" released by "delete_volume" :: held 1.408s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:42 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-76abf22d-155e-41a0-b522-12231dea7a87 tempest-ProjectMemberTests-737282236 None] Created reservations ['097a1f7a-5320-494c-ac76-8e8264c72de3', '2ebefaa8-ab12-4fec-a6b8-b61586731ed2', 'fe2a1961-ba11-4858-8949-31df80ccd63c', '5f320442-d522-41f3-826d-d2b52f5089a1'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-76abf22d-155e-41a0-b522-12231dea7a87 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-76abf22d-155e-41a0-b522-12231dea7a87 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-76abf22d-155e-41a0-b522-12231dea7a87 tempest-ProjectMemberTests-737282236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-76abf22d-155e-41a0-b522-12231dea7a87 tempest-ProjectMemberTests-737282236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-76abf22d-155e-41a0-b522-12231dea7a87 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76abf22d-155e-41a0-b522-12231dea7a87 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:43 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:55:43 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:43 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76abf22d-155e-41a0-b522-12231dea7a87 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.663s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:43 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-76abf22d-155e-41a0-b522-12231dea7a87 tempest-ProjectMemberTests-737282236 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:55:43 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-76abf22d-155e-41a0-b522-12231dea7a87 tempest-ProjectMemberTests-737282236 None] Deleted volume successfully. Jul 08 14:55:43 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76abf22d-155e-41a0-b522-12231dea7a87 tempest-ProjectMemberTests-737282236 None] Lock "cinder-f8f4c766-0966-49d1-bf9c-d2a19e763395-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:44 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:55:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Flow 'volume_create_manager' (132bc657-d106-49cc-bd1e-7ac7447f913a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54efd5e3-d5a3-435a-b74c-978cb37ca0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54efd5e3-d5a3-435a-b74c-978cb37ca0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1726423161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e064d2cc-ec57-4549-900f-7b32765c3f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f2a705845349cea974ee3355d8b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:55:44Z,use_quota=True,user_id='9a8e1a48636043f98dd223ab9abf06db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e490e62-b804-40b8-abc6-fb77811fabc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e490e62-b804-40b8-abc6-fb77811fabc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0baa2bf2-5771-4002-bba3-c0a488d1ee70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0baa2bf2-5771-4002-bba3-c0a488d1ee70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e064d2cc-ec57-4549-900f-7b32765c3f93', 'volume_name': 'volume-e064d2cc-ec57-4549-900f-7b32765c3f93', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ebccee-009d-4c88-a391-2c6983acb7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7ebccee-009d-4c88-a391-2c6983acb7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:44 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f223cfc-2883-4631-b5ec-da47040a0b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:44 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Volume e064d2cc-ec57-4549-900f-7b32765c3f93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e064d2cc-ec57-4549-900f-7b32765c3f93', 'volume_size': 1} Jul 08 14:55:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1726423161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e064d2cc-ec57-4549-900f-7b32765c3f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f2a705845349cea974ee3355d8b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:55:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:55:44Z,use_quota=True,user_id='9a8e1a48636043f98dd223ab9abf06db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:55:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Creating volume e064d2cc-ec57-4549-900f-7b32765c3f93 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:55:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:44 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:55:44 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:55:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:44 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93 1073741824 Jul 08 14:55:44 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:44 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93 1073741824" returned: 0 in 0.847s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:45 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93 Jul 08 14:55:45 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:45 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93" returned: 0 in 0.666s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:45 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:55:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f223cfc-2883-4631-b5ec-da47040a0b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e064d2cc-ec57-4549-900f-7b32765c3f93', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b946d3a-9ce4-43ad-a378-7516b3e5fcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:45 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Volume volume-e064d2cc-ec57-4549-900f-7b32765c3f93 (e064d2cc-ec57-4549-900f-7b32765c3f93): created successfully Jul 08 14:55:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b946d3a-9ce4-43ad-a378-7516b3e5fcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:45 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Flow 'volume_create_manager' (132bc657-d106-49cc-bd1e-7ac7447f913a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:45 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6e6ded22-a0b5-4eac-b28f-464bdc3c49db tempest-ProjectMemberTests-737282236 None] Created volume successfully. Jul 08 14:55:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6ac2a5a4-5fb6-43af-8c68-923b41259c1e tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6ac2a5a4-5fb6-43af-8c68-923b41259c1e tempest-ProjectMemberTests-737282236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:46 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-6ac2a5a4-5fb6-43af-8c68-923b41259c1e tempest-ProjectMemberTests-737282236 None] Creating offline snapshot 1550a6d4-2313-4147-8b8c-0ae4d9c8a12a of volume e064d2cc-ec57-4549-900f-7b32765c3f93 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:55:46 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[02be2f29-6e35-45f5-b4ba-4ebca07bbc66]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6ac2a5a4-5fb6-43af-8c68-923b41259c1e tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:46 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93 Jul 08 14:55:46 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:47 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6ac2a5a4-5fb6-43af-8c68-923b41259c1e tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93" returned: 0 in 0.745s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6ac2a5a4-5fb6-43af-8c68-923b41259c1e tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.1550a6d4-2313-4147-8b8c-0ae4d9c8a12a 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:47 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.1550a6d4-2313-4147-8b8c-0ae4d9c8a12a 1G Jul 08 14:55:47 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:47 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6ac2a5a4-5fb6-43af-8c68-923b41259c1e tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.1550a6d4-2313-4147-8b8c-0ae4d9c8a12a 1G" returned: 0 in 0.820s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6ac2a5a4-5fb6-43af-8c68-923b41259c1e tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e064d2cc-ec57-4549-900f-7b32765c3f93 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.1550a6d4-2313-4147-8b8c-0ae4d9c8a12a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:47 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e064d2cc-ec57-4549-900f-7b32765c3f93 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.1550a6d4-2313-4147-8b8c-0ae4d9c8a12a Jul 08 14:55:47 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:48 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6ac2a5a4-5fb6-43af-8c68-923b41259c1e tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e064d2cc-ec57-4549-900f-7b32765c3f93 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.1550a6d4-2313-4147-8b8c-0ae4d9c8a12a" returned: 0 in 0.670s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:48 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-6ac2a5a4-5fb6-43af-8c68-923b41259c1e tempest-ProjectMemberTests-737282236 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.1550a6d4-2313-4147-8b8c-0ae4d9c8a12a is being set with open permissions: ugo+rw Jul 08 14:55:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6ac2a5a4-5fb6-43af-8c68-923b41259c1e tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.1550a6d4-2313-4147-8b8c-0ae4d9c8a12a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:48 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.1550a6d4-2313-4147-8b8c-0ae4d9c8a12a Jul 08 14:55:48 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:49 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6ac2a5a4-5fb6-43af-8c68-923b41259c1e tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.1550a6d4-2313-4147-8b8c-0ae4d9c8a12a" returned: 0 in 0.654s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6ac2a5a4-5fb6-43af-8c68-923b41259c1e tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:49 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.info Jul 08 14:55:49 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:49 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6ac2a5a4-5fb6-43af-8c68-923b41259c1e tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.info" returned: 0 in 0.635s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:49 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-6ac2a5a4-5fb6-43af-8c68-923b41259c1e tempest-ProjectMemberTests-737282236 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.info is being set with open permissions: ugo+rw Jul 08 14:55:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6ac2a5a4-5fb6-43af-8c68-923b41259c1e tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:49 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.info Jul 08 14:55:49 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:50 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-6ac2a5a4-5fb6-43af-8c68-923b41259c1e tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.info" returned: 0 in 0.624s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-6ac2a5a4-5fb6-43af-8c68-923b41259c1e tempest-ProjectMemberTests-737282236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.222s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:50 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-6ac2a5a4-5fb6-43af-8c68-923b41259c1e tempest-ProjectMemberTests-737282236 None] Create snapshot completed successfully Jul 08 14:55:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-72379174-acff-434b-9691-b9511561452c tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-1550a6d4-2313-4147-8b8c-0ae4d9c8a12a-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-72379174-acff-434b-9691-b9511561452c tempest-ProjectMemberTests-737282236 None] Lock "cinder-1550a6d4-2313-4147-8b8c-0ae4d9c8a12a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-72379174-acff-434b-9691-b9511561452c tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-e064d2cc-ec57-4549-900f-7b32765c3f93" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-72379174-acff-434b-9691-b9511561452c tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-e064d2cc-ec57-4549-900f-7b32765c3f93" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-72379174-acff-434b-9691-b9511561452c tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-1550a6d4-2313-4147-8b8c-0ae4d9c8a12a" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-72379174-acff-434b-9691-b9511561452c tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-1550a6d4-2313-4147-8b8c-0ae4d9c8a12a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-72379174-acff-434b-9691-b9511561452c tempest-ProjectMemberTests-737282236 None] Deleting offline snapshot 1550a6d4-2313-4147-8b8c-0ae4d9c8a12a of volume e064d2cc-ec57-4549-900f-7b32765c3f93 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:55:51 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-72379174-acff-434b-9691-b9511561452c tempest-ProjectMemberTests-737282236 None] snapshot_file for this snap is: volume-e064d2cc-ec57-4549-900f-7b32765c3f93.1550a6d4-2313-4147-8b8c-0ae4d9c8a12a {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:55:51 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3534ac4-95e7-478d-b8d3-48803fae18d1]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-72379174-acff-434b-9691-b9511561452c tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.1550a6d4-2313-4147-8b8c-0ae4d9c8a12a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:51 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.1550a6d4-2313-4147-8b8c-0ae4d9c8a12a Jul 08 14:55:51 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:52 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-72379174-acff-434b-9691-b9511561452c tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.1550a6d4-2313-4147-8b8c-0ae4d9c8a12a" returned: 0 in 0.732s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:52 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-72379174-acff-434b-9691-b9511561452c tempest-ProjectMemberTests-737282236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e064d2cc-ec57-4549-900f-7b32765c3f93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:55:52 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1dbabc-1abd-4533-85a2-ed2efda6c8cc]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-72379174-acff-434b-9691-b9511561452c tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:52 devstack sudo[107919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93 Jul 08 14:55:52 devstack sudo[107919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:53 devstack sudo[107919]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-72379174-acff-434b-9691-b9511561452c tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93" returned: 0 in 0.749s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-72379174-acff-434b-9691-b9511561452c tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.1550a6d4-2313-4147-8b8c-0ae4d9c8a12a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:53 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.1550a6d4-2313-4147-8b8c-0ae4d9c8a12a Jul 08 14:55:53 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:53 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-72379174-acff-434b-9691-b9511561452c tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.1550a6d4-2313-4147-8b8c-0ae4d9c8a12a" returned: 0 in 0.752s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-72379174-acff-434b-9691-b9511561452c tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.1550a6d4-2313-4147-8b8c-0ae4d9c8a12a {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:53 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.1550a6d4-2313-4147-8b8c-0ae4d9c8a12a Jul 08 14:55:53 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:54 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-72379174-acff-434b-9691-b9511561452c tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93.1550a6d4-2313-4147-8b8c-0ae4d9c8a12a" returned: 0 in 0.654s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-72379174-acff-434b-9691-b9511561452c tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-1550a6d4-2313-4147-8b8c-0ae4d9c8a12a" released by "_delete_snapshot" :: held 2.975s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-72379174-acff-434b-9691-b9511561452c tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-e064d2cc-ec57-4549-900f-7b32765c3f93" released by "delete_snapshot" :: held 2.998s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:54 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-72379174-acff-434b-9691-b9511561452c tempest-ProjectMemberTests-737282236 None] Created reservations ['b343e25b-fee6-4602-9159-674ee8c39e19', '64828e3a-4bee-4955-9be6-672ac8a7044b', '2177754e-4c36-4d0e-a42d-9e0a97e096ca', '51c3d607-1c59-4718-8515-02faaf194384'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:54 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-72379174-acff-434b-9691-b9511561452c tempest-ProjectMemberTests-737282236 None] Delete snapshot completed successfully. Jul 08 14:55:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-72379174-acff-434b-9691-b9511561452c tempest-ProjectMemberTests-737282236 None] Lock "cinder-1550a6d4-2313-4147-8b8c-0ae4d9c8a12a-delete_snapshot" released by "delete_snapshot" :: held 3.136s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-822bc067-f705-42ba-93a9-8289e6d00002 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-e064d2cc-ec57-4549-900f-7b32765c3f93-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-822bc067-f705-42ba-93a9-8289e6d00002 tempest-ProjectMemberTests-737282236 None] Lock "cinder-e064d2cc-ec57-4549-900f-7b32765c3f93-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-822bc067-f705-42ba-93a9-8289e6d00002 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-e064d2cc-ec57-4549-900f-7b32765c3f93" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:55:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-822bc067-f705-42ba-93a9-8289e6d00002 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-e064d2cc-ec57-4549-900f-7b32765c3f93" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:55:54 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d67fc3a-54bf-4648-ba89-d1e504cd0332]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-822bc067-f705-42ba-93a9-8289e6d00002 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:54 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93 Jul 08 14:55:54 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:55 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-822bc067-f705-42ba-93a9-8289e6d00002 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93" returned: 0 in 0.730s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-822bc067-f705-42ba-93a9-8289e6d00002 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:55 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93 Jul 08 14:55:55 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:56 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-822bc067-f705-42ba-93a9-8289e6d00002 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e064d2cc-ec57-4549-900f-7b32765c3f93" returned: 0 in 0.623s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-822bc067-f705-42ba-93a9-8289e6d00002 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-e064d2cc-ec57-4549-900f-7b32765c3f93" released by "delete_volume" :: held 1.406s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:56 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-822bc067-f705-42ba-93a9-8289e6d00002 tempest-ProjectMemberTests-737282236 None] Created reservations ['21635e5c-fb87-4d9f-9a15-dc85cf5b5760', '8f4e42ac-35d4-4cc6-8b1c-2eb29f48e402', '26ea1c9a-8a16-4316-8b05-b9ae8580bf43', '57fd548a-a758-4919-9eaa-d8c1160cfb09'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:55:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-822bc067-f705-42ba-93a9-8289e6d00002 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-822bc067-f705-42ba-93a9-8289e6d00002 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-822bc067-f705-42ba-93a9-8289e6d00002 tempest-ProjectMemberTests-737282236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-822bc067-f705-42ba-93a9-8289e6d00002 tempest-ProjectMemberTests-737282236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-822bc067-f705-42ba-93a9-8289e6d00002 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-822bc067-f705-42ba-93a9-8289e6d00002 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:56 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:55:56 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:56 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-822bc067-f705-42ba-93a9-8289e6d00002 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.618s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:56 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-822bc067-f705-42ba-93a9-8289e6d00002 tempest-ProjectMemberTests-737282236 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:55:56 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-822bc067-f705-42ba-93a9-8289e6d00002 tempest-ProjectMemberTests-737282236 None] Deleted volume successfully. Jul 08 14:55:56 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-822bc067-f705-42ba-93a9-8289e6d00002 tempest-ProjectMemberTests-737282236 None] Lock "cinder-e064d2cc-ec57-4549-900f-7b32765c3f93-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:55:57 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:55:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Flow 'volume_create_manager' (1519e681-ab07-48b5-86f4-4f2d79b55b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b36022b5-4e94-4f79-9505-ef75fe84782e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b36022b5-4e94-4f79-9505-ef75fe84782e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-723076007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3af0bc3-6b00-4993-9014-a617be604539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f2a705845349cea974ee3355d8b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:55:57Z,use_quota=True,user_id='9a8e1a48636043f98dd223ab9abf06db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d7e72d-1e50-4783-8ab8-3eb54fa88029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d7e72d-1e50-4783-8ab8-3eb54fa88029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815f5c2e-8a68-4776-a918-4ece65499224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815f5c2e-8a68-4776-a918-4ece65499224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3af0bc3-6b00-4993-9014-a617be604539', 'volume_name': 'volume-a3af0bc3-6b00-4993-9014-a617be604539', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20fad4da-1517-4699-a91b-bf0beada1821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20fad4da-1517-4699-a91b-bf0beada1821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:57 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490a6d0d-97f9-4ad6-af05-457d3676adfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:57 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Volume a3af0bc3-6b00-4993-9014-a617be604539: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3af0bc3-6b00-4993-9014-a617be604539', 'volume_size': 1} Jul 08 14:55:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-723076007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3af0bc3-6b00-4993-9014-a617be604539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f2a705845349cea974ee3355d8b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:55:57Z,use_quota=True,user_id='9a8e1a48636043f98dd223ab9abf06db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:55:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Creating volume a3af0bc3-6b00-4993-9014-a617be604539 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:55:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:57 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:55:57 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:55:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:57 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539 1073741824 Jul 08 14:55:57 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:58 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539 1073741824" returned: 0 in 0.757s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:58 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539 Jul 08 14:55:58 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:58 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539" returned: 0 in 0.608s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:58 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:55:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.404s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (490a6d0d-97f9-4ad6-af05-457d3676adfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3af0bc3-6b00-4993-9014-a617be604539', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dcd58da-0451-4ef8-ad8a-3c0e4b5142f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:55:58 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Volume volume-a3af0bc3-6b00-4993-9014-a617be604539 (a3af0bc3-6b00-4993-9014-a617be604539): created successfully Jul 08 14:55:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dcd58da-0451-4ef8-ad8a-3c0e4b5142f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:55:58 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Flow 'volume_create_manager' (1519e681-ab07-48b5-86f4-4f2d79b55b75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:55:58 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f6a0fa47-5966-4dbf-a5c8-eb8854e576a3 tempest-ProjectMemberTests-737282236 None] Created volume successfully. Jul 08 14:55:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:55:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:55:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:55:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:55:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:59 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:55:59 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ebd6ebfd-5927-44e6-9023-2da2a539c7d2 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:55:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ebd6ebfd-5927-44e6-9023-2da2a539c7d2 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:55:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-ebd6ebfd-5927-44e6-9023-2da2a539c7d2 tempest-ProjectMemberTests-737282236 None] Creating offline snapshot cba15289-01cf-4eb4-baae-ad44fca0b761 of volume a3af0bc3-6b00-4993-9014-a617be604539 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:55:59 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e31465-050d-4129-bd4d-32e16affad9b]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:55:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ebd6ebfd-5927-44e6-9023-2da2a539c7d2 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:55:59 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539 Jul 08 14:55:59 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:55:59 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Jul 08 14:55:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.635s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:55:59 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:56:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:56:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:56:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:56:00 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ebd6ebfd-5927-44e6-9023-2da2a539c7d2 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539" returned: 0 in 0.751s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ebd6ebfd-5927-44e6-9023-2da2a539c7d2 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.cba15289-01cf-4eb4-baae-ad44fca0b761 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:00 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.cba15289-01cf-4eb4-baae-ad44fca0b761 1G Jul 08 14:56:00 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:01 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ebd6ebfd-5927-44e6-9023-2da2a539c7d2 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.cba15289-01cf-4eb4-baae-ad44fca0b761 1G" returned: 0 in 0.754s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ebd6ebfd-5927-44e6-9023-2da2a539c7d2 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3af0bc3-6b00-4993-9014-a617be604539 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.cba15289-01cf-4eb4-baae-ad44fca0b761 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:01 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3af0bc3-6b00-4993-9014-a617be604539 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.cba15289-01cf-4eb4-baae-ad44fca0b761 Jul 08 14:56:01 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:01 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ebd6ebfd-5927-44e6-9023-2da2a539c7d2 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3af0bc3-6b00-4993-9014-a617be604539 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.cba15289-01cf-4eb4-baae-ad44fca0b761" returned: 0 in 0.658s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:01 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-ebd6ebfd-5927-44e6-9023-2da2a539c7d2 tempest-ProjectMemberTests-737282236 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.cba15289-01cf-4eb4-baae-ad44fca0b761 is being set with open permissions: ugo+rw Jul 08 14:56:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ebd6ebfd-5927-44e6-9023-2da2a539c7d2 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.cba15289-01cf-4eb4-baae-ad44fca0b761 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:01 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.cba15289-01cf-4eb4-baae-ad44fca0b761 Jul 08 14:56:01 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:02 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ebd6ebfd-5927-44e6-9023-2da2a539c7d2 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.cba15289-01cf-4eb4-baae-ad44fca0b761" returned: 0 in 0.700s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:02 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=98,cinder:SELECT=86,cinder:INSERT=28,cinder:DELETE=7 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:56:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ebd6ebfd-5927-44e6-9023-2da2a539c7d2 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:02 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.info Jul 08 14:56:02 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:03 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ebd6ebfd-5927-44e6-9023-2da2a539c7d2 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.info" returned: 0 in 0.644s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:03 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-ebd6ebfd-5927-44e6-9023-2da2a539c7d2 tempest-ProjectMemberTests-737282236 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.info is being set with open permissions: ugo+rw Jul 08 14:56:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ebd6ebfd-5927-44e6-9023-2da2a539c7d2 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:03 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.info Jul 08 14:56:03 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:03 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ebd6ebfd-5927-44e6-9023-2da2a539c7d2 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.info" returned: 0 in 0.617s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ebd6ebfd-5927-44e6-9023-2da2a539c7d2 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.212s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:03 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=114,cinder:SELECT=75,cinder:INSERT=30,cinder:DELETE=9 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:56:03 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ebd6ebfd-5927-44e6-9023-2da2a539c7d2 tempest-ProjectMemberTests-737282236 None] Create snapshot completed successfully Jul 08 14:56:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0130f75b-2aef-4fab-aa89-ef9b53277815 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-cba15289-01cf-4eb4-baae-ad44fca0b761-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0130f75b-2aef-4fab-aa89-ef9b53277815 tempest-ProjectMemberTests-737282236 None] Lock "cinder-cba15289-01cf-4eb4-baae-ad44fca0b761-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0130f75b-2aef-4fab-aa89-ef9b53277815 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-a3af0bc3-6b00-4993-9014-a617be604539" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0130f75b-2aef-4fab-aa89-ef9b53277815 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-a3af0bc3-6b00-4993-9014-a617be604539" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0130f75b-2aef-4fab-aa89-ef9b53277815 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-cba15289-01cf-4eb4-baae-ad44fca0b761" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0130f75b-2aef-4fab-aa89-ef9b53277815 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-cba15289-01cf-4eb4-baae-ad44fca0b761" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0130f75b-2aef-4fab-aa89-ef9b53277815 tempest-ProjectMemberTests-737282236 None] Deleting offline snapshot cba15289-01cf-4eb4-baae-ad44fca0b761 of volume a3af0bc3-6b00-4993-9014-a617be604539 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:56:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0130f75b-2aef-4fab-aa89-ef9b53277815 tempest-ProjectMemberTests-737282236 None] snapshot_file for this snap is: volume-a3af0bc3-6b00-4993-9014-a617be604539.cba15289-01cf-4eb4-baae-ad44fca0b761 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:56:04 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2aa427-6275-431c-9b2f-84391a3a47ad]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:56:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0130f75b-2aef-4fab-aa89-ef9b53277815 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.cba15289-01cf-4eb4-baae-ad44fca0b761 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:04 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.cba15289-01cf-4eb4-baae-ad44fca0b761 Jul 08 14:56:04 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:05 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0130f75b-2aef-4fab-aa89-ef9b53277815 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.cba15289-01cf-4eb4-baae-ad44fca0b761" returned: 0 in 0.726s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:05 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0130f75b-2aef-4fab-aa89-ef9b53277815 tempest-ProjectMemberTests-737282236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3af0bc3-6b00-4993-9014-a617be604539(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:56:05 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f922c475-7670-4103-b059-24cb277ad0a1]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:56:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0130f75b-2aef-4fab-aa89-ef9b53277815 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:05 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539 Jul 08 14:56:05 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:06 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0130f75b-2aef-4fab-aa89-ef9b53277815 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539" returned: 0 in 0.760s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0130f75b-2aef-4fab-aa89-ef9b53277815 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.cba15289-01cf-4eb4-baae-ad44fca0b761 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:06 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.cba15289-01cf-4eb4-baae-ad44fca0b761 Jul 08 14:56:06 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:07 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0130f75b-2aef-4fab-aa89-ef9b53277815 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.cba15289-01cf-4eb4-baae-ad44fca0b761" returned: 0 in 0.712s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0130f75b-2aef-4fab-aa89-ef9b53277815 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.cba15289-01cf-4eb4-baae-ad44fca0b761 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:07 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.cba15289-01cf-4eb4-baae-ad44fca0b761 Jul 08 14:56:07 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:07 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0130f75b-2aef-4fab-aa89-ef9b53277815 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539.cba15289-01cf-4eb4-baae-ad44fca0b761" returned: 0 in 0.631s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0130f75b-2aef-4fab-aa89-ef9b53277815 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-cba15289-01cf-4eb4-baae-ad44fca0b761" released by "_delete_snapshot" :: held 2.912s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0130f75b-2aef-4fab-aa89-ef9b53277815 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-a3af0bc3-6b00-4993-9014-a617be604539" released by "delete_snapshot" :: held 2.936s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:07 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-0130f75b-2aef-4fab-aa89-ef9b53277815 tempest-ProjectMemberTests-737282236 None] Created reservations ['5ac14f85-d326-452b-9d55-1d9263b9b7d5', 'fa43cdea-56a1-4c45-bdec-587be9f03f7f', 'db3c3007-763a-4b07-8f18-09766bf641f4', '631a8c1d-b0d5-46eb-a062-171561f11ad2'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:56:07 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0130f75b-2aef-4fab-aa89-ef9b53277815 tempest-ProjectMemberTests-737282236 None] Delete snapshot completed successfully. Jul 08 14:56:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-0130f75b-2aef-4fab-aa89-ef9b53277815 tempest-ProjectMemberTests-737282236 None] Lock "cinder-cba15289-01cf-4eb4-baae-ad44fca0b761-delete_snapshot" released by "delete_snapshot" :: held 3.072s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-33fa2741-0c09-4352-8ae0-a37cd896a059 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-a3af0bc3-6b00-4993-9014-a617be604539-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-33fa2741-0c09-4352-8ae0-a37cd896a059 tempest-ProjectMemberTests-737282236 None] Lock "cinder-a3af0bc3-6b00-4993-9014-a617be604539-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-33fa2741-0c09-4352-8ae0-a37cd896a059 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-a3af0bc3-6b00-4993-9014-a617be604539" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-33fa2741-0c09-4352-8ae0-a37cd896a059 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-a3af0bc3-6b00-4993-9014-a617be604539" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:08 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dbf94c-d1ed-44bf-8551-8da7e0dba73d]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:56:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-33fa2741-0c09-4352-8ae0-a37cd896a059 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:08 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539 Jul 08 14:56:08 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:08 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-33fa2741-0c09-4352-8ae0-a37cd896a059 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539" returned: 0 in 0.751s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-33fa2741-0c09-4352-8ae0-a37cd896a059 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:08 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539 Jul 08 14:56:08 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:09 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-33fa2741-0c09-4352-8ae0-a37cd896a059 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3af0bc3-6b00-4993-9014-a617be604539" returned: 0 in 0.642s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:09 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-33fa2741-0c09-4352-8ae0-a37cd896a059 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-a3af0bc3-6b00-4993-9014-a617be604539" released by "delete_volume" :: held 1.445s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:09 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-33fa2741-0c09-4352-8ae0-a37cd896a059 tempest-ProjectMemberTests-737282236 None] Created reservations ['cc09897a-852f-4947-8ae8-19340c96a4cf', '4e078a4f-d068-4698-bb75-ee8ed31512ef', '9de2f725-7174-4b29-a9e7-a5437aac6f83', '57675aea-6eee-4b53-bffb-3afd43b6503d'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:56:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-33fa2741-0c09-4352-8ae0-a37cd896a059 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:56:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-33fa2741-0c09-4352-8ae0-a37cd896a059 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:56:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-33fa2741-0c09-4352-8ae0-a37cd896a059 tempest-ProjectMemberTests-737282236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:56:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-33fa2741-0c09-4352-8ae0-a37cd896a059 tempest-ProjectMemberTests-737282236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:56:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-33fa2741-0c09-4352-8ae0-a37cd896a059 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-33fa2741-0c09-4352-8ae0-a37cd896a059 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:09 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:56:09 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:10 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-33fa2741-0c09-4352-8ae0-a37cd896a059 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.642s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-33fa2741-0c09-4352-8ae0-a37cd896a059 tempest-ProjectMemberTests-737282236 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:56:10 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-33fa2741-0c09-4352-8ae0-a37cd896a059 tempest-ProjectMemberTests-737282236 None] Deleted volume successfully. Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-33fa2741-0c09-4352-8ae0-a37cd896a059 tempest-ProjectMemberTests-737282236 None] Lock "cinder-a3af0bc3-6b00-4993-9014-a617be604539-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Flow 'volume_create_manager' (b74cac8b-9728-493a-9b0d-89035e78e6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a7cb45-381d-4d40-913d-c54986159a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a7cb45-381d-4d40-913d-c54986159a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1741655849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61fe7af3-7db3-49d0-b0a3-d76289994294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f2a705845349cea974ee3355d8b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:56:11Z,use_quota=True,user_id='9a8e1a48636043f98dd223ab9abf06db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (523ceb45-3b8d-4f2c-8d51-7534b1c2888e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (523ceb45-3b8d-4f2c-8d51-7534b1c2888e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0282537b-615b-4a02-b6d1-68fccb34f4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0282537b-615b-4a02-b6d1-68fccb34f4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61fe7af3-7db3-49d0-b0a3-d76289994294', 'volume_name': 'volume-61fe7af3-7db3-49d0-b0a3-d76289994294', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61fe4137-8780-4bd1-aa09-a47d55186dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61fe4137-8780-4bd1-aa09-a47d55186dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad74661-fd97-4ea6-9821-ba06a9d36e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:10 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Volume 61fe7af3-7db3-49d0-b0a3-d76289994294: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61fe7af3-7db3-49d0-b0a3-d76289994294', 'volume_size': 1} Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1741655849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61fe7af3-7db3-49d0-b0a3-d76289994294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f2a705845349cea974ee3355d8b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:56:11Z,use_quota=True,user_id='9a8e1a48636043f98dd223ab9abf06db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Creating volume 61fe7af3-7db3-49d0-b0a3-d76289994294 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:56:10 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:56:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:10 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294 1073741824 Jul 08 14:56:10 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:11 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294 1073741824" returned: 0 in 0.830s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:11 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294 Jul 08 14:56:11 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:12 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294" returned: 0 in 0.616s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:56:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aad74661-fd97-4ea6-9821-ba06a9d36e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61fe7af3-7db3-49d0-b0a3-d76289994294', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ffecdcb-f038-4920-909f-57d80050846d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:12 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Volume volume-61fe7af3-7db3-49d0-b0a3-d76289994294 (61fe7af3-7db3-49d0-b0a3-d76289994294): created successfully Jul 08 14:56:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ffecdcb-f038-4920-909f-57d80050846d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:12 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Flow 'volume_create_manager' (b74cac8b-9728-493a-9b0d-89035e78e6d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:56:12 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8e4943a0-c4d7-449d-a7a8-cb312d86e509 tempest-ProjectMemberTests-737282236 None] Created volume successfully. Jul 08 14:56:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eee32bcb-aa8e-4436-912a-35a436705cf8 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:56:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eee32bcb-aa8e-4436-912a-35a436705cf8 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:56:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-eee32bcb-aa8e-4436-912a-35a436705cf8 tempest-ProjectMemberTests-737282236 None] Creating offline snapshot 0225a406-8977-4c5c-9483-ac0201d910b1 of volume 61fe7af3-7db3-49d0-b0a3-d76289994294 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:56:12 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e99a7f-f75c-4edd-b9f7-832de0ee3938]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:56:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eee32bcb-aa8e-4436-912a-35a436705cf8 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:13 devstack sudo[108064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294 Jul 08 14:56:13 devstack sudo[108064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:13 devstack sudo[108064]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eee32bcb-aa8e-4436-912a-35a436705cf8 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294" returned: 0 in 0.723s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eee32bcb-aa8e-4436-912a-35a436705cf8 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.0225a406-8977-4c5c-9483-ac0201d910b1 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:13 devstack sudo[108069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.0225a406-8977-4c5c-9483-ac0201d910b1 1G Jul 08 14:56:13 devstack sudo[108069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:14 devstack sudo[108069]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eee32bcb-aa8e-4436-912a-35a436705cf8 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.0225a406-8977-4c5c-9483-ac0201d910b1 1G" returned: 0 in 0.781s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eee32bcb-aa8e-4436-912a-35a436705cf8 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61fe7af3-7db3-49d0-b0a3-d76289994294 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.0225a406-8977-4c5c-9483-ac0201d910b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:14 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61fe7af3-7db3-49d0-b0a3-d76289994294 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.0225a406-8977-4c5c-9483-ac0201d910b1 Jul 08 14:56:14 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:15 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eee32bcb-aa8e-4436-912a-35a436705cf8 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61fe7af3-7db3-49d0-b0a3-d76289994294 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.0225a406-8977-4c5c-9483-ac0201d910b1" returned: 0 in 0.656s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:15 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-eee32bcb-aa8e-4436-912a-35a436705cf8 tempest-ProjectMemberTests-737282236 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.0225a406-8977-4c5c-9483-ac0201d910b1 is being set with open permissions: ugo+rw Jul 08 14:56:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eee32bcb-aa8e-4436-912a-35a436705cf8 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.0225a406-8977-4c5c-9483-ac0201d910b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:15 devstack sudo[108079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.0225a406-8977-4c5c-9483-ac0201d910b1 Jul 08 14:56:15 devstack sudo[108079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:15 devstack sudo[108079]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eee32bcb-aa8e-4436-912a-35a436705cf8 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.0225a406-8977-4c5c-9483-ac0201d910b1" returned: 0 in 0.624s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eee32bcb-aa8e-4436-912a-35a436705cf8 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:15 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.info Jul 08 14:56:15 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:16 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eee32bcb-aa8e-4436-912a-35a436705cf8 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.info" returned: 0 in 0.655s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:16 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-eee32bcb-aa8e-4436-912a-35a436705cf8 tempest-ProjectMemberTests-737282236 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.info is being set with open permissions: ugo+rw Jul 08 14:56:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eee32bcb-aa8e-4436-912a-35a436705cf8 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:16 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.info Jul 08 14:56:16 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:17 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eee32bcb-aa8e-4436-912a-35a436705cf8 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.info" returned: 0 in 0.630s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eee32bcb-aa8e-4436-912a-35a436705cf8 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.186s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:17 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-eee32bcb-aa8e-4436-912a-35a436705cf8 tempest-ProjectMemberTests-737282236 None] Create snapshot completed successfully Jul 08 14:56:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4577e0cb-1630-4cf2-bdbe-816faa0bb5c3 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-0225a406-8977-4c5c-9483-ac0201d910b1-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4577e0cb-1630-4cf2-bdbe-816faa0bb5c3 tempest-ProjectMemberTests-737282236 None] Lock "cinder-0225a406-8977-4c5c-9483-ac0201d910b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4577e0cb-1630-4cf2-bdbe-816faa0bb5c3 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-61fe7af3-7db3-49d0-b0a3-d76289994294" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4577e0cb-1630-4cf2-bdbe-816faa0bb5c3 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-61fe7af3-7db3-49d0-b0a3-d76289994294" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4577e0cb-1630-4cf2-bdbe-816faa0bb5c3 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-0225a406-8977-4c5c-9483-ac0201d910b1" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4577e0cb-1630-4cf2-bdbe-816faa0bb5c3 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-0225a406-8977-4c5c-9483-ac0201d910b1" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-4577e0cb-1630-4cf2-bdbe-816faa0bb5c3 tempest-ProjectMemberTests-737282236 None] Deleting offline snapshot 0225a406-8977-4c5c-9483-ac0201d910b1 of volume 61fe7af3-7db3-49d0-b0a3-d76289994294 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:56:18 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-4577e0cb-1630-4cf2-bdbe-816faa0bb5c3 tempest-ProjectMemberTests-737282236 None] snapshot_file for this snap is: volume-61fe7af3-7db3-49d0-b0a3-d76289994294.0225a406-8977-4c5c-9483-ac0201d910b1 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:56:18 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[53986c83-099c-4ce4-8fc0-e8c5c25fcfde]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:56:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4577e0cb-1630-4cf2-bdbe-816faa0bb5c3 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.0225a406-8977-4c5c-9483-ac0201d910b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:18 devstack sudo[108088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.0225a406-8977-4c5c-9483-ac0201d910b1 Jul 08 14:56:18 devstack sudo[108088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:19 devstack sudo[108088]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4577e0cb-1630-4cf2-bdbe-816faa0bb5c3 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.0225a406-8977-4c5c-9483-ac0201d910b1" returned: 0 in 0.779s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:19 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-4577e0cb-1630-4cf2-bdbe-816faa0bb5c3 tempest-ProjectMemberTests-737282236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61fe7af3-7db3-49d0-b0a3-d76289994294(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:56:19 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e75631-1439-4158-96ed-af865142889c]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:56:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4577e0cb-1630-4cf2-bdbe-816faa0bb5c3 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:19 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294 Jul 08 14:56:19 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:19 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4577e0cb-1630-4cf2-bdbe-816faa0bb5c3 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294" returned: 0 in 0.765s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4577e0cb-1630-4cf2-bdbe-816faa0bb5c3 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.0225a406-8977-4c5c-9483-ac0201d910b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:19 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.0225a406-8977-4c5c-9483-ac0201d910b1 Jul 08 14:56:19 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:20 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4577e0cb-1630-4cf2-bdbe-816faa0bb5c3 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.0225a406-8977-4c5c-9483-ac0201d910b1" returned: 0 in 0.774s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4577e0cb-1630-4cf2-bdbe-816faa0bb5c3 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.0225a406-8977-4c5c-9483-ac0201d910b1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:20 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.0225a406-8977-4c5c-9483-ac0201d910b1 Jul 08 14:56:20 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:21 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4577e0cb-1630-4cf2-bdbe-816faa0bb5c3 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294.0225a406-8977-4c5c-9483-ac0201d910b1" returned: 0 in 0.718s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4577e0cb-1630-4cf2-bdbe-816faa0bb5c3 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-0225a406-8977-4c5c-9483-ac0201d910b1" released by "_delete_snapshot" :: held 3.124s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4577e0cb-1630-4cf2-bdbe-816faa0bb5c3 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-61fe7af3-7db3-49d0-b0a3-d76289994294" released by "delete_snapshot" :: held 3.145s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:21 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-4577e0cb-1630-4cf2-bdbe-816faa0bb5c3 tempest-ProjectMemberTests-737282236 None] Created reservations ['cf9003a6-f1cb-440b-bd3e-c05f32d8f525', '4ccbfeb2-330f-4daa-b5e9-181cb4cdccf0', 'bc41df94-34b4-4a1a-a5d8-68dccf44449a', '8afc9099-bbca-45bb-a72a-876447f72fe5'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:56:21 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4577e0cb-1630-4cf2-bdbe-816faa0bb5c3 tempest-ProjectMemberTests-737282236 None] Delete snapshot completed successfully. Jul 08 14:56:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4577e0cb-1630-4cf2-bdbe-816faa0bb5c3 tempest-ProjectMemberTests-737282236 None] Lock "cinder-0225a406-8977-4c5c-9483-ac0201d910b1-delete_snapshot" released by "delete_snapshot" :: held 3.302s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3eed693e-f607-4e11-839f-65b6625b88bb tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-61fe7af3-7db3-49d0-b0a3-d76289994294-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3eed693e-f607-4e11-839f-65b6625b88bb tempest-ProjectMemberTests-737282236 None] Lock "cinder-61fe7af3-7db3-49d0-b0a3-d76289994294-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3eed693e-f607-4e11-839f-65b6625b88bb tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-61fe7af3-7db3-49d0-b0a3-d76289994294" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:22 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3eed693e-f607-4e11-839f-65b6625b88bb tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-61fe7af3-7db3-49d0-b0a3-d76289994294" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:22 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[49254547-fd6c-4121-a313-804c969a0a7a]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:56:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3eed693e-f607-4e11-839f-65b6625b88bb tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:22 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294 Jul 08 14:56:22 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:23 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3eed693e-f607-4e11-839f-65b6625b88bb tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294" returned: 0 in 0.813s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3eed693e-f607-4e11-839f-65b6625b88bb tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:23 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294 Jul 08 14:56:23 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:24 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3eed693e-f607-4e11-839f-65b6625b88bb tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-61fe7af3-7db3-49d0-b0a3-d76289994294" returned: 0 in 0.678s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3eed693e-f607-4e11-839f-65b6625b88bb tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-61fe7af3-7db3-49d0-b0a3-d76289994294" released by "delete_volume" :: held 1.549s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:24 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-3eed693e-f607-4e11-839f-65b6625b88bb tempest-ProjectMemberTests-737282236 None] Created reservations ['766be371-936d-4865-b513-e0b896192e3f', '29964b1d-4d4d-4568-b122-9e55872157e2', '24e338d3-db01-4dd5-9c8b-05b80eb6a4fd', '29c9b608-d96a-44df-80ab-713f19344eac'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:56:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3eed693e-f607-4e11-839f-65b6625b88bb tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:56:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3eed693e-f607-4e11-839f-65b6625b88bb tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:56:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3eed693e-f607-4e11-839f-65b6625b88bb tempest-ProjectMemberTests-737282236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:56:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-3eed693e-f607-4e11-839f-65b6625b88bb tempest-ProjectMemberTests-737282236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:56:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3eed693e-f607-4e11-839f-65b6625b88bb tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3eed693e-f607-4e11-839f-65b6625b88bb tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:24 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:56:24 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:24 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3eed693e-f607-4e11-839f-65b6625b88bb tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.695s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:24 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-3eed693e-f607-4e11-839f-65b6625b88bb tempest-ProjectMemberTests-737282236 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:56:24 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3eed693e-f607-4e11-839f-65b6625b88bb tempest-ProjectMemberTests-737282236 None] Deleted volume successfully. Jul 08 14:56:24 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-3eed693e-f607-4e11-839f-65b6625b88bb tempest-ProjectMemberTests-737282236 None] Lock "cinder-61fe7af3-7db3-49d0-b0a3-d76289994294-delete_volume" released by "delete_volume" :: held 2.447s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:25 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:56:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Flow 'volume_create_manager' (bf15fdb0-75dd-46ad-af98-7564f99c25ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:56:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be78397-4751-4c5d-8981-baa9f3fc25d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8be78397-4751-4c5d-8981-baa9f3fc25d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-286303905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb66989-5ab8-42c8-bb48-977130e4b5a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f2a705845349cea974ee3355d8b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:56:25Z,use_quota=True,user_id='9a8e1a48636043f98dd223ab9abf06db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e5ecff0-0bb1-42e7-8812-040087948efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e5ecff0-0bb1-42e7-8812-040087948efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52030ca-7ffb-4ece-94fc-c50315909f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f52030ca-7ffb-4ece-94fc-c50315909f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fb66989-5ab8-42c8-bb48-977130e4b5a1', 'volume_name': 'volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db93f203-7b91-482e-81f2-8ee314f76c73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db93f203-7b91-482e-81f2-8ee314f76c73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:25 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4b1bd2-12f6-45d3-afc9-567fe118946b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:25 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Volume 7fb66989-5ab8-42c8-bb48-977130e4b5a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1', 'volume_size': 1} Jul 08 14:56:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:56:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:56:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-286303905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fb66989-5ab8-42c8-bb48-977130e4b5a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f2a705845349cea974ee3355d8b014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:56:25Z,use_quota=True,user_id='9a8e1a48636043f98dd223ab9abf06db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:56:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Creating volume 7fb66989-5ab8-42c8-bb48-977130e4b5a1 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:56:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:56:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:56:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:56:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:56:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:25 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:56:25 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:56:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:25 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1 1073741824 Jul 08 14:56:25 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:26 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1 1073741824" returned: 0 in 0.839s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:26 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1 Jul 08 14:56:26 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:26 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1" returned: 0 in 0.724s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:26 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:56:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4b1bd2-12f6-45d3-afc9-567fe118946b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d00b626-3a65-43c1-9b53-2ff279d3ca06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:26 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Volume volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1 (7fb66989-5ab8-42c8-bb48-977130e4b5a1): created successfully Jul 08 14:56:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d00b626-3a65-43c1-9b53-2ff279d3ca06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:26 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Flow 'volume_create_manager' (bf15fdb0-75dd-46ad-af98-7564f99c25ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:56:26 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5d54d109-9cd6-4402-8d84-11d009338b69 tempest-ProjectMemberTests-737282236 None] Created volume successfully. Jul 08 14:56:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-910509c5-4630-4762-ab69-f25ff3ab2988 tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:56:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-910509c5-4630-4762-ab69-f25ff3ab2988 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:56:27 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-910509c5-4630-4762-ab69-f25ff3ab2988 tempest-ProjectMemberTests-737282236 None] Creating offline snapshot 321e6505-9383-45e3-a8ca-5e2ed057e6a5 of volume 7fb66989-5ab8-42c8-bb48-977130e4b5a1 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:56:27 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb69399d-d962-4129-8429-d2ced5e8f0bd]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:56:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-910509c5-4630-4762-ab69-f25ff3ab2988 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:27 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1 Jul 08 14:56:27 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:28 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-910509c5-4630-4762-ab69-f25ff3ab2988 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1" returned: 0 in 0.794s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-910509c5-4630-4762-ab69-f25ff3ab2988 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.321e6505-9383-45e3-a8ca-5e2ed057e6a5 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:28 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.321e6505-9383-45e3-a8ca-5e2ed057e6a5 1G Jul 08 14:56:28 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:29 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-910509c5-4630-4762-ab69-f25ff3ab2988 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.321e6505-9383-45e3-a8ca-5e2ed057e6a5 1G" returned: 0 in 0.803s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-910509c5-4630-4762-ab69-f25ff3ab2988 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.321e6505-9383-45e3-a8ca-5e2ed057e6a5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:29 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.321e6505-9383-45e3-a8ca-5e2ed057e6a5 Jul 08 14:56:29 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:29 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-910509c5-4630-4762-ab69-f25ff3ab2988 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.321e6505-9383-45e3-a8ca-5e2ed057e6a5" returned: 0 in 0.697s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:29 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-910509c5-4630-4762-ab69-f25ff3ab2988 tempest-ProjectMemberTests-737282236 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.321e6505-9383-45e3-a8ca-5e2ed057e6a5 is being set with open permissions: ugo+rw Jul 08 14:56:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-910509c5-4630-4762-ab69-f25ff3ab2988 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.321e6505-9383-45e3-a8ca-5e2ed057e6a5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:29 devstack sudo[108141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.321e6505-9383-45e3-a8ca-5e2ed057e6a5 Jul 08 14:56:29 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:30 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-910509c5-4630-4762-ab69-f25ff3ab2988 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.321e6505-9383-45e3-a8ca-5e2ed057e6a5" returned: 0 in 0.624s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-910509c5-4630-4762-ab69-f25ff3ab2988 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:30 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.info Jul 08 14:56:30 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:30 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-910509c5-4630-4762-ab69-f25ff3ab2988 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.info" returned: 0 in 0.643s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:30 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-910509c5-4630-4762-ab69-f25ff3ab2988 tempest-ProjectMemberTests-737282236 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.info is being set with open permissions: ugo+rw Jul 08 14:56:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-910509c5-4630-4762-ab69-f25ff3ab2988 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:31 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.info Jul 08 14:56:31 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:31 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-910509c5-4630-4762-ab69-f25ff3ab2988 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.info" returned: 0 in 0.656s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-910509c5-4630-4762-ab69-f25ff3ab2988 tempest-ProjectMemberTests-737282236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.292s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:31 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-910509c5-4630-4762-ab69-f25ff3ab2988 tempest-ProjectMemberTests-737282236 None] Create snapshot completed successfully Jul 08 14:56:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-38e06407-27f8-45cd-94aa-f35170ba3695 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-321e6505-9383-45e3-a8ca-5e2ed057e6a5-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-38e06407-27f8-45cd-94aa-f35170ba3695 tempest-ProjectMemberTests-737282236 None] Lock "cinder-321e6505-9383-45e3-a8ca-5e2ed057e6a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-38e06407-27f8-45cd-94aa-f35170ba3695 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-7fb66989-5ab8-42c8-bb48-977130e4b5a1" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-38e06407-27f8-45cd-94aa-f35170ba3695 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-7fb66989-5ab8-42c8-bb48-977130e4b5a1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-38e06407-27f8-45cd-94aa-f35170ba3695 tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-321e6505-9383-45e3-a8ca-5e2ed057e6a5" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-38e06407-27f8-45cd-94aa-f35170ba3695 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-321e6505-9383-45e3-a8ca-5e2ed057e6a5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-38e06407-27f8-45cd-94aa-f35170ba3695 tempest-ProjectMemberTests-737282236 None] Deleting offline snapshot 321e6505-9383-45e3-a8ca-5e2ed057e6a5 of volume 7fb66989-5ab8-42c8-bb48-977130e4b5a1 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:56:32 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-38e06407-27f8-45cd-94aa-f35170ba3695 tempest-ProjectMemberTests-737282236 None] snapshot_file for this snap is: volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.321e6505-9383-45e3-a8ca-5e2ed057e6a5 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:56:32 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[326d3c31-a076-447a-885b-fce8dcac4cf0]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:56:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e06407-27f8-45cd-94aa-f35170ba3695 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.321e6505-9383-45e3-a8ca-5e2ed057e6a5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:32 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.321e6505-9383-45e3-a8ca-5e2ed057e6a5 Jul 08 14:56:32 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:33 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e06407-27f8-45cd-94aa-f35170ba3695 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.321e6505-9383-45e3-a8ca-5e2ed057e6a5" returned: 0 in 0.734s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:33 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-38e06407-27f8-45cd-94aa-f35170ba3695 tempest-ProjectMemberTests-737282236 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:56:33 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f5ffd0-97af-497c-9d4f-f7b18cf8e1d1]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:56:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e06407-27f8-45cd-94aa-f35170ba3695 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:33 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1 Jul 08 14:56:33 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:34 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e06407-27f8-45cd-94aa-f35170ba3695 tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1" returned: 0 in 0.734s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e06407-27f8-45cd-94aa-f35170ba3695 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.321e6505-9383-45e3-a8ca-5e2ed057e6a5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:34 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.321e6505-9383-45e3-a8ca-5e2ed057e6a5 Jul 08 14:56:34 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:34 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e06407-27f8-45cd-94aa-f35170ba3695 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.321e6505-9383-45e3-a8ca-5e2ed057e6a5" returned: 0 in 0.708s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e06407-27f8-45cd-94aa-f35170ba3695 tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.321e6505-9383-45e3-a8ca-5e2ed057e6a5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:34 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.321e6505-9383-45e3-a8ca-5e2ed057e6a5 Jul 08 14:56:34 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:35 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-38e06407-27f8-45cd-94aa-f35170ba3695 tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1.321e6505-9383-45e3-a8ca-5e2ed057e6a5" returned: 0 in 0.633s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-38e06407-27f8-45cd-94aa-f35170ba3695 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-321e6505-9383-45e3-a8ca-5e2ed057e6a5" released by "_delete_snapshot" :: held 2.890s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-38e06407-27f8-45cd-94aa-f35170ba3695 tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-7fb66989-5ab8-42c8-bb48-977130e4b5a1" released by "delete_snapshot" :: held 2.910s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:35 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-38e06407-27f8-45cd-94aa-f35170ba3695 tempest-ProjectMemberTests-737282236 None] Created reservations ['5f67e1a8-e2fc-4dcd-9654-c48387dd9914', '85b749f6-1414-45aa-aeda-d7f2de0d9723', '5a1ce1bf-6669-44b4-bc36-2ab265abfe67', 'f518f768-c2a6-40df-9a4f-ca4ce33736a5'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:56:35 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-38e06407-27f8-45cd-94aa-f35170ba3695 tempest-ProjectMemberTests-737282236 None] Delete snapshot completed successfully. Jul 08 14:56:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-38e06407-27f8-45cd-94aa-f35170ba3695 tempest-ProjectMemberTests-737282236 None] Lock "cinder-321e6505-9383-45e3-a8ca-5e2ed057e6a5-delete_snapshot" released by "delete_snapshot" :: held 3.031s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4ade6ac9-1ed9-4e0e-a80f-c65e002889be tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-7fb66989-5ab8-42c8-bb48-977130e4b5a1-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4ade6ac9-1ed9-4e0e-a80f-c65e002889be tempest-ProjectMemberTests-737282236 None] Lock "cinder-7fb66989-5ab8-42c8-bb48-977130e4b5a1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4ade6ac9-1ed9-4e0e-a80f-c65e002889be tempest-ProjectMemberTests-737282236 None] Acquiring lock "cinder-quobyte-7fb66989-5ab8-42c8-bb48-977130e4b5a1" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4ade6ac9-1ed9-4e0e-a80f-c65e002889be tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-7fb66989-5ab8-42c8-bb48-977130e4b5a1" acquired by "delete_volume" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:35 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[5604d274-0cde-4afd-81f7-2a681dd90d48]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:56:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4ade6ac9-1ed9-4e0e-a80f-c65e002889be tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:36 devstack sudo[108169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1 Jul 08 14:56:36 devstack sudo[108169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:36 devstack sudo[108169]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4ade6ac9-1ed9-4e0e-a80f-c65e002889be tempest-ProjectMemberTests-737282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1" returned: 0 in 0.704s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4ade6ac9-1ed9-4e0e-a80f-c65e002889be tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:36 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1 Jul 08 14:56:36 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:37 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4ade6ac9-1ed9-4e0e-a80f-c65e002889be tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-7fb66989-5ab8-42c8-bb48-977130e4b5a1" returned: 0 in 0.611s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:37 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4ade6ac9-1ed9-4e0e-a80f-c65e002889be tempest-ProjectMemberTests-737282236 None] Lock "cinder-quobyte-7fb66989-5ab8-42c8-bb48-977130e4b5a1" released by "delete_volume" :: held 1.369s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:37 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-4ade6ac9-1ed9-4e0e-a80f-c65e002889be tempest-ProjectMemberTests-737282236 None] Created reservations ['e6ea6690-c59b-4845-9f25-e1f34d89dc61', '0814b16f-4d55-494c-a4cc-d66ea40fc7fd', '8432386c-8380-4d0d-b0d1-392598600228', '9b03bdfa-347a-49b9-8d9f-414e34720b3a'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:56:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4ade6ac9-1ed9-4e0e-a80f-c65e002889be tempest-ProjectMemberTests-737282236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:56:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4ade6ac9-1ed9-4e0e-a80f-c65e002889be tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:56:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4ade6ac9-1ed9-4e0e-a80f-c65e002889be tempest-ProjectMemberTests-737282236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:56:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4ade6ac9-1ed9-4e0e-a80f-c65e002889be tempest-ProjectMemberTests-737282236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:56:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4ade6ac9-1ed9-4e0e-a80f-c65e002889be tempest-ProjectMemberTests-737282236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4ade6ac9-1ed9-4e0e-a80f-c65e002889be tempest-ProjectMemberTests-737282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:37 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:56:37 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:38 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4ade6ac9-1ed9-4e0e-a80f-c65e002889be tempest-ProjectMemberTests-737282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.623s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:38 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-4ade6ac9-1ed9-4e0e-a80f-c65e002889be tempest-ProjectMemberTests-737282236 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:56:38 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4ade6ac9-1ed9-4e0e-a80f-c65e002889be tempest-ProjectMemberTests-737282236 None] Deleted volume successfully. Jul 08 14:56:38 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-4ade6ac9-1ed9-4e0e-a80f-c65e002889be tempest-ProjectMemberTests-737282236 None] Lock "cinder-7fb66989-5ab8-42c8-bb48-977130e4b5a1-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:41 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:56:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Flow 'volume_create_manager' (584663a5-1fe1-43b1-8d77-b88e7432b78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:56:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6486f66-cd58-49c3-8e50-183d2eb0d545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6486f66-cd58-49c3-8e50-183d2eb0d545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-571260599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae065149-505c-450d-b798-2bc514c6d31f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25ed869be60d4956a3cb8a0bacfd17c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:56:41Z,use_quota=True,user_id='8176ee5185794fbc9ca064cb629d04d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5cc4b22-55a6-4134-80d2-b33b986a68d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5cc4b22-55a6-4134-80d2-b33b986a68d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ee7f90-964a-4f16-abc1-d787e76543e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ee7f90-964a-4f16-abc1-d787e76543e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae065149-505c-450d-b798-2bc514c6d31f', 'volume_name': 'volume-ae065149-505c-450d-b798-2bc514c6d31f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f4de80b-67cd-4d37-834a-b3a2457ef95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f4de80b-67cd-4d37-834a-b3a2457ef95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:41 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f80873a-deac-4a15-8972-52c6fabd5a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:41 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Volume ae065149-505c-450d-b798-2bc514c6d31f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae065149-505c-450d-b798-2bc514c6d31f', 'volume_size': 1} Jul 08 14:56:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:56:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:56:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-571260599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae065149-505c-450d-b798-2bc514c6d31f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25ed869be60d4956a3cb8a0bacfd17c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:56:41Z,use_quota=True,user_id='8176ee5185794fbc9ca064cb629d04d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:56:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Creating volume ae065149-505c-450d-b798-2bc514c6d31f {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:56:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:56:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:56:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:56:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:56:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:41 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:56:41 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:56:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:41 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f 1073741824 Jul 08 14:56:41 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:42 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f 1073741824" returned: 0 in 0.798s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:42 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f Jul 08 14:56:42 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:42 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f" returned: 0 in 0.636s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] <== create_volume: return (1473ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:56:42 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f80873a-deac-4a15-8972-52c6fabd5a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae065149-505c-450d-b798-2bc514c6d31f', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa0dbd2-00ef-4a38-9c1f-017204ea8a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:42 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Volume volume-ae065149-505c-450d-b798-2bc514c6d31f (ae065149-505c-450d-b798-2bc514c6d31f): created successfully Jul 08 14:56:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa0dbd2-00ef-4a38-9c1f-017204ea8a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:42 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Flow 'volume_create_manager' (584663a5-1fe1-43b1-8d77-b88e7432b78c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:56:42 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-62e87118-9332-4071-b178-b182871a6496 tempest-ProjectReaderTests-162064681 None] Created volume successfully. Jul 08 14:56:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0031aba7-07bd-48bb-be5b-7f61b37aa361 tempest-ProjectReaderTests-162064681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:56:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0031aba7-07bd-48bb-be5b-7f61b37aa361 tempest-ProjectReaderTests-162064681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:56:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0031aba7-07bd-48bb-be5b-7f61b37aa361 tempest-ProjectReaderTests-162064681 None] Creating offline snapshot e36147da-ef23-4bea-8503-14ead3e16924 of volume ae065149-505c-450d-b798-2bc514c6d31f {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:56:43 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f629c1-bb67-4e14-ae8a-df7740f25e76]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:56:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0031aba7-07bd-48bb-be5b-7f61b37aa361 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:43 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f Jul 08 14:56:43 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:44 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0031aba7-07bd-48bb-be5b-7f61b37aa361 tempest-ProjectReaderTests-162064681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f" returned: 0 in 0.725s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0031aba7-07bd-48bb-be5b-7f61b37aa361 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.e36147da-ef23-4bea-8503-14ead3e16924 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:44 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.e36147da-ef23-4bea-8503-14ead3e16924 1G Jul 08 14:56:44 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:45 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0031aba7-07bd-48bb-be5b-7f61b37aa361 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.e36147da-ef23-4bea-8503-14ead3e16924 1G" returned: 0 in 0.743s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0031aba7-07bd-48bb-be5b-7f61b37aa361 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae065149-505c-450d-b798-2bc514c6d31f -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.e36147da-ef23-4bea-8503-14ead3e16924 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:45 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae065149-505c-450d-b798-2bc514c6d31f -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.e36147da-ef23-4bea-8503-14ead3e16924 Jul 08 14:56:45 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:45 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0031aba7-07bd-48bb-be5b-7f61b37aa361 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae065149-505c-450d-b798-2bc514c6d31f -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.e36147da-ef23-4bea-8503-14ead3e16924" returned: 0 in 0.660s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:45 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-0031aba7-07bd-48bb-be5b-7f61b37aa361 tempest-ProjectReaderTests-162064681 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.e36147da-ef23-4bea-8503-14ead3e16924 is being set with open permissions: ugo+rw Jul 08 14:56:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0031aba7-07bd-48bb-be5b-7f61b37aa361 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.e36147da-ef23-4bea-8503-14ead3e16924 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:45 devstack sudo[108206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.e36147da-ef23-4bea-8503-14ead3e16924 Jul 08 14:56:45 devstack sudo[108206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:46 devstack sudo[108206]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0031aba7-07bd-48bb-be5b-7f61b37aa361 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.e36147da-ef23-4bea-8503-14ead3e16924" returned: 0 in 0.613s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0031aba7-07bd-48bb-be5b-7f61b37aa361 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:46 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.info Jul 08 14:56:46 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:47 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0031aba7-07bd-48bb-be5b-7f61b37aa361 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.info" returned: 0 in 0.632s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:47 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-0031aba7-07bd-48bb-be5b-7f61b37aa361 tempest-ProjectReaderTests-162064681 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.info is being set with open permissions: ugo+rw Jul 08 14:56:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0031aba7-07bd-48bb-be5b-7f61b37aa361 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:47 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.info Jul 08 14:56:47 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:47 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0031aba7-07bd-48bb-be5b-7f61b37aa361 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.info" returned: 0 in 0.612s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0031aba7-07bd-48bb-be5b-7f61b37aa361 tempest-ProjectReaderTests-162064681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.068s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:47 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0031aba7-07bd-48bb-be5b-7f61b37aa361 tempest-ProjectReaderTests-162064681 None] Create snapshot completed successfully Jul 08 14:56:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-34a48554-ac52-44c7-b95f-8ea30d9bf032 tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-e36147da-ef23-4bea-8503-14ead3e16924-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-34a48554-ac52-44c7-b95f-8ea30d9bf032 tempest-ProjectReaderTests-162064681 None] Lock "cinder-e36147da-ef23-4bea-8503-14ead3e16924-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-34a48554-ac52-44c7-b95f-8ea30d9bf032 tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-quobyte-ae065149-505c-450d-b798-2bc514c6d31f" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-34a48554-ac52-44c7-b95f-8ea30d9bf032 tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-ae065149-505c-450d-b798-2bc514c6d31f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-34a48554-ac52-44c7-b95f-8ea30d9bf032 tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-quobyte-e36147da-ef23-4bea-8503-14ead3e16924" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-34a48554-ac52-44c7-b95f-8ea30d9bf032 tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-e36147da-ef23-4bea-8503-14ead3e16924" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-34a48554-ac52-44c7-b95f-8ea30d9bf032 tempest-ProjectReaderTests-162064681 None] Deleting offline snapshot e36147da-ef23-4bea-8503-14ead3e16924 of volume ae065149-505c-450d-b798-2bc514c6d31f {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:56:48 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-34a48554-ac52-44c7-b95f-8ea30d9bf032 tempest-ProjectReaderTests-162064681 None] snapshot_file for this snap is: volume-ae065149-505c-450d-b798-2bc514c6d31f.e36147da-ef23-4bea-8503-14ead3e16924 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:56:48 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[04de08ba-038f-47cd-aa93-02054f166f52]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:56:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-34a48554-ac52-44c7-b95f-8ea30d9bf032 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.e36147da-ef23-4bea-8503-14ead3e16924 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:49 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.e36147da-ef23-4bea-8503-14ead3e16924 Jul 08 14:56:49 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:49 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-34a48554-ac52-44c7-b95f-8ea30d9bf032 tempest-ProjectReaderTests-162064681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.e36147da-ef23-4bea-8503-14ead3e16924" returned: 0 in 0.733s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:49 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-34a48554-ac52-44c7-b95f-8ea30d9bf032 tempest-ProjectReaderTests-162064681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae065149-505c-450d-b798-2bc514c6d31f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:56:49 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[163647cd-77d9-43c7-8da4-b590d18f476f]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:56:49 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-34a48554-ac52-44c7-b95f-8ea30d9bf032 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:49 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f Jul 08 14:56:49 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:50 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-34a48554-ac52-44c7-b95f-8ea30d9bf032 tempest-ProjectReaderTests-162064681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f" returned: 0 in 0.737s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:50 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-34a48554-ac52-44c7-b95f-8ea30d9bf032 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.e36147da-ef23-4bea-8503-14ead3e16924 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:50 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.e36147da-ef23-4bea-8503-14ead3e16924 Jul 08 14:56:50 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:51 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-34a48554-ac52-44c7-b95f-8ea30d9bf032 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.e36147da-ef23-4bea-8503-14ead3e16924" returned: 0 in 0.697s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-34a48554-ac52-44c7-b95f-8ea30d9bf032 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.e36147da-ef23-4bea-8503-14ead3e16924 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:51 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.e36147da-ef23-4bea-8503-14ead3e16924 Jul 08 14:56:51 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:51 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:51 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-34a48554-ac52-44c7-b95f-8ea30d9bf032 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f.e36147da-ef23-4bea-8503-14ead3e16924" returned: 0 in 0.627s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-34a48554-ac52-44c7-b95f-8ea30d9bf032 tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-e36147da-ef23-4bea-8503-14ead3e16924" released by "_delete_snapshot" :: held 2.885s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-34a48554-ac52-44c7-b95f-8ea30d9bf032 tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-ae065149-505c-450d-b798-2bc514c6d31f" released by "delete_snapshot" :: held 2.908s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:51 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-34a48554-ac52-44c7-b95f-8ea30d9bf032 tempest-ProjectReaderTests-162064681 None] Created reservations ['e2635e61-b2d3-4080-8204-e1746e54be52', '75fbadcb-349b-43a3-8cf8-f2a03ca9a974', '3187bab0-b9eb-43a8-8891-0914d616e313', '6d06d61a-e939-42f0-9394-d6d3efd90f78'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:56:51 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-34a48554-ac52-44c7-b95f-8ea30d9bf032 tempest-ProjectReaderTests-162064681 None] Delete snapshot completed successfully. Jul 08 14:56:51 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-34a48554-ac52-44c7-b95f-8ea30d9bf032 tempest-ProjectReaderTests-162064681 None] Lock "cinder-e36147da-ef23-4bea-8503-14ead3e16924-delete_snapshot" released by "delete_snapshot" :: held 3.040s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fca9c057-5816-4e94-a110-7caafdcc8fbf tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-ae065149-505c-450d-b798-2bc514c6d31f-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fca9c057-5816-4e94-a110-7caafdcc8fbf tempest-ProjectReaderTests-162064681 None] Lock "cinder-ae065149-505c-450d-b798-2bc514c6d31f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fca9c057-5816-4e94-a110-7caafdcc8fbf tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-quobyte-ae065149-505c-450d-b798-2bc514c6d31f" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:56:52 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fca9c057-5816-4e94-a110-7caafdcc8fbf tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-ae065149-505c-450d-b798-2bc514c6d31f" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:56:52 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c2f761-029f-422d-a35d-470c2f44bac7]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:56:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fca9c057-5816-4e94-a110-7caafdcc8fbf tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:52 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f Jul 08 14:56:52 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:52 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fca9c057-5816-4e94-a110-7caafdcc8fbf tempest-ProjectReaderTests-162064681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f" returned: 0 in 0.719s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:52 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fca9c057-5816-4e94-a110-7caafdcc8fbf tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:52 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f Jul 08 14:56:52 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:53 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fca9c057-5816-4e94-a110-7caafdcc8fbf tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-ae065149-505c-450d-b798-2bc514c6d31f" returned: 0 in 0.626s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:53 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fca9c057-5816-4e94-a110-7caafdcc8fbf tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-ae065149-505c-450d-b798-2bc514c6d31f" released by "delete_volume" :: held 1.401s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:53 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-fca9c057-5816-4e94-a110-7caafdcc8fbf tempest-ProjectReaderTests-162064681 None] Created reservations ['a1bdfba2-e3f4-4a82-97cc-20b2cf7aa7aa', '80afb2fa-bb0a-4456-9b16-f10b37611254', 'cf2c381c-3d01-4b4e-b8db-120ed2c7664a', '9e1cde40-3326-46f6-97ad-2d55b1d31075'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:56:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fca9c057-5816-4e94-a110-7caafdcc8fbf tempest-ProjectReaderTests-162064681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:56:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fca9c057-5816-4e94-a110-7caafdcc8fbf tempest-ProjectReaderTests-162064681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:56:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fca9c057-5816-4e94-a110-7caafdcc8fbf tempest-ProjectReaderTests-162064681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:56:53 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fca9c057-5816-4e94-a110-7caafdcc8fbf tempest-ProjectReaderTests-162064681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:56:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fca9c057-5816-4e94-a110-7caafdcc8fbf tempest-ProjectReaderTests-162064681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:53 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fca9c057-5816-4e94-a110-7caafdcc8fbf tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:53 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:56:53 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:54 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fca9c057-5816-4e94-a110-7caafdcc8fbf tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.622s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-fca9c057-5816-4e94-a110-7caafdcc8fbf tempest-ProjectReaderTests-162064681 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:56:54 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fca9c057-5816-4e94-a110-7caafdcc8fbf tempest-ProjectReaderTests-162064681 None] Deleted volume successfully. Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fca9c057-5816-4e94-a110-7caafdcc8fbf tempest-ProjectReaderTests-162064681 None] Lock "cinder-ae065149-505c-450d-b798-2bc514c6d31f-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Flow 'volume_create_manager' (faaf9ebf-1e79-48a7-bfc1-ce55a767113b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72b7aeb5-ab0d-444f-b788-f18b1ffdb969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72b7aeb5-ab0d-444f-b788-f18b1ffdb969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-441708816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27a5c786-ee6b-41bd-a501-5857e75cd647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25ed869be60d4956a3cb8a0bacfd17c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:56:55Z,use_quota=True,user_id='8176ee5185794fbc9ca064cb629d04d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00af911d-420a-4991-b892-aff5ad80e3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00af911d-420a-4991-b892-aff5ad80e3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15dbf0ba-8555-4e26-be5e-f25f5b2979d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15dbf0ba-8555-4e26-be5e-f25f5b2979d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27a5c786-ee6b-41bd-a501-5857e75cd647', 'volume_name': 'volume-27a5c786-ee6b-41bd-a501-5857e75cd647', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d606fc8-23ef-455c-9121-1e93446c9554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d606fc8-23ef-455c-9121-1e93446c9554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda0f79a-1aab-4259-a2ab-c5f51ce4323c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:54 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Volume 27a5c786-ee6b-41bd-a501-5857e75cd647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27a5c786-ee6b-41bd-a501-5857e75cd647', 'volume_size': 1} Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:56:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-441708816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27a5c786-ee6b-41bd-a501-5857e75cd647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25ed869be60d4956a3cb8a0bacfd17c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:56:55Z,use_quota=True,user_id='8176ee5185794fbc9ca064cb629d04d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Creating volume 27a5c786-ee6b-41bd-a501-5857e75cd647 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:56:54 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:56:54 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:54 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647 1073741824 Jul 08 14:56:54 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:55 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647 1073741824" returned: 0 in 0.768s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:55 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:55 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647 Jul 08 14:56:55 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:56 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647" returned: 0 in 0.609s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:56:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda0f79a-1aab-4259-a2ab-c5f51ce4323c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27a5c786-ee6b-41bd-a501-5857e75cd647', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db28c6e-1321-4407-ae71-18eeaa3a143d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:56:56 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Volume volume-27a5c786-ee6b-41bd-a501-5857e75cd647 (27a5c786-ee6b-41bd-a501-5857e75cd647): created successfully Jul 08 14:56:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0db28c6e-1321-4407-ae71-18eeaa3a143d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:56:56 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Flow 'volume_create_manager' (faaf9ebf-1e79-48a7-bfc1-ce55a767113b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:56:56 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-0797cdde-dd98-482f-b17a-5cbbaeaad609 tempest-ProjectReaderTests-162064681 None] Created volume successfully. Jul 08 14:56:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3be956e0-01a1-4b7b-be92-e7844e219c6c tempest-ProjectReaderTests-162064681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:56:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3be956e0-01a1-4b7b-be92-e7844e219c6c tempest-ProjectReaderTests-162064681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:56:56 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-3be956e0-01a1-4b7b-be92-e7844e219c6c tempest-ProjectReaderTests-162064681 None] Creating offline snapshot 9a93958b-e791-4062-ae9d-99f8707114b4 of volume 27a5c786-ee6b-41bd-a501-5857e75cd647 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:56:56 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[2395a82c-29da-42f4-8f3f-2c9fc98d38a6]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:56:56 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3be956e0-01a1-4b7b-be92-e7844e219c6c tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:57 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647 Jul 08 14:56:57 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:57 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3be956e0-01a1-4b7b-be92-e7844e219c6c tempest-ProjectReaderTests-162064681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647" returned: 0 in 0.709s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:57 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3be956e0-01a1-4b7b-be92-e7844e219c6c tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.9a93958b-e791-4062-ae9d-99f8707114b4 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:57 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.9a93958b-e791-4062-ae9d-99f8707114b4 1G Jul 08 14:56:57 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:58 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3be956e0-01a1-4b7b-be92-e7844e219c6c tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.9a93958b-e791-4062-ae9d-99f8707114b4 1G" returned: 0 in 0.767s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:58 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3be956e0-01a1-4b7b-be92-e7844e219c6c tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27a5c786-ee6b-41bd-a501-5857e75cd647 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.9a93958b-e791-4062-ae9d-99f8707114b4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:58 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27a5c786-ee6b-41bd-a501-5857e75cd647 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.9a93958b-e791-4062-ae9d-99f8707114b4 Jul 08 14:56:58 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:59 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3be956e0-01a1-4b7b-be92-e7844e219c6c tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27a5c786-ee6b-41bd-a501-5857e75cd647 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.9a93958b-e791-4062-ae9d-99f8707114b4" returned: 0 in 0.650s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:59 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-3be956e0-01a1-4b7b-be92-e7844e219c6c tempest-ProjectReaderTests-162064681 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.9a93958b-e791-4062-ae9d-99f8707114b4 is being set with open permissions: ugo+rw Jul 08 14:56:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3be956e0-01a1-4b7b-be92-e7844e219c6c tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.9a93958b-e791-4062-ae9d-99f8707114b4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:59 devstack sudo[108315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.9a93958b-e791-4062-ae9d-99f8707114b4 Jul 08 14:56:59 devstack sudo[108315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:56:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:56:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:56:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:56:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:56:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:56:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:59 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:56:59 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:59 devstack sudo[108315]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3be956e0-01a1-4b7b-be92-e7844e219c6c tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.9a93958b-e791-4062-ae9d-99f8707114b4" returned: 0 in 0.668s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3be956e0-01a1-4b7b-be92-e7844e219c6c tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:56:59 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.info Jul 08 14:56:59 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:56:59 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Jul 08 14:56:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.627s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:56:59 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:57:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:57:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:57:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:57:00 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3be956e0-01a1-4b7b-be92-e7844e219c6c tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.info" returned: 0 in 0.643s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:00 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-3be956e0-01a1-4b7b-be92-e7844e219c6c tempest-ProjectReaderTests-162064681 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.info is being set with open permissions: ugo+rw Jul 08 14:57:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3be956e0-01a1-4b7b-be92-e7844e219c6c tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:00 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.info Jul 08 14:57:00 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:01 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3be956e0-01a1-4b7b-be92-e7844e219c6c tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.info" returned: 0 in 0.601s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3be956e0-01a1-4b7b-be92-e7844e219c6c tempest-ProjectReaderTests-162064681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.115s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:57:01 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3be956e0-01a1-4b7b-be92-e7844e219c6c tempest-ProjectReaderTests-162064681 None] Create snapshot completed successfully Jul 08 14:57:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-87ba60b5-e75e-45e1-b6e8-70d2c94d91e4 tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-9a93958b-e791-4062-ae9d-99f8707114b4-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:57:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-87ba60b5-e75e-45e1-b6e8-70d2c94d91e4 tempest-ProjectReaderTests-162064681 None] Lock "cinder-9a93958b-e791-4062-ae9d-99f8707114b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:57:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-87ba60b5-e75e-45e1-b6e8-70d2c94d91e4 tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-quobyte-27a5c786-ee6b-41bd-a501-5857e75cd647" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:57:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-87ba60b5-e75e-45e1-b6e8-70d2c94d91e4 tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-27a5c786-ee6b-41bd-a501-5857e75cd647" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:57:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-87ba60b5-e75e-45e1-b6e8-70d2c94d91e4 tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-quobyte-9a93958b-e791-4062-ae9d-99f8707114b4" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:57:02 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-87ba60b5-e75e-45e1-b6e8-70d2c94d91e4 tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-9a93958b-e791-4062-ae9d-99f8707114b4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:57:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-87ba60b5-e75e-45e1-b6e8-70d2c94d91e4 tempest-ProjectReaderTests-162064681 None] Deleting offline snapshot 9a93958b-e791-4062-ae9d-99f8707114b4 of volume 27a5c786-ee6b-41bd-a501-5857e75cd647 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:57:02 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-87ba60b5-e75e-45e1-b6e8-70d2c94d91e4 tempest-ProjectReaderTests-162064681 None] snapshot_file for this snap is: volume-27a5c786-ee6b-41bd-a501-5857e75cd647.9a93958b-e791-4062-ae9d-99f8707114b4 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:57:02 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb35441-4067-4519-a0a1-7525619e3508]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:57:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-87ba60b5-e75e-45e1-b6e8-70d2c94d91e4 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.9a93958b-e791-4062-ae9d-99f8707114b4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:02 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.9a93958b-e791-4062-ae9d-99f8707114b4 Jul 08 14:57:02 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:03 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-87ba60b5-e75e-45e1-b6e8-70d2c94d91e4 tempest-ProjectReaderTests-162064681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.9a93958b-e791-4062-ae9d-99f8707114b4" returned: 0 in 0.777s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-87ba60b5-e75e-45e1-b6e8-70d2c94d91e4 tempest-ProjectReaderTests-162064681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27a5c786-ee6b-41bd-a501-5857e75cd647(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:57:03 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[541e763b-433e-451b-b2c3-4c5a137d065b]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:57:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-87ba60b5-e75e-45e1-b6e8-70d2c94d91e4 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:03 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647 Jul 08 14:57:03 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:03 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-87ba60b5-e75e-45e1-b6e8-70d2c94d91e4 tempest-ProjectReaderTests-162064681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647" returned: 0 in 0.758s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-87ba60b5-e75e-45e1-b6e8-70d2c94d91e4 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.9a93958b-e791-4062-ae9d-99f8707114b4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:03 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.9a93958b-e791-4062-ae9d-99f8707114b4 Jul 08 14:57:03 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:04 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-87ba60b5-e75e-45e1-b6e8-70d2c94d91e4 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.9a93958b-e791-4062-ae9d-99f8707114b4" returned: 0 in 0.791s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-87ba60b5-e75e-45e1-b6e8-70d2c94d91e4 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.9a93958b-e791-4062-ae9d-99f8707114b4 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:04 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.9a93958b-e791-4062-ae9d-99f8707114b4 Jul 08 14:57:04 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:05 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-87ba60b5-e75e-45e1-b6e8-70d2c94d91e4 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647.9a93958b-e791-4062-ae9d-99f8707114b4" returned: 0 in 0.632s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-87ba60b5-e75e-45e1-b6e8-70d2c94d91e4 tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-9a93958b-e791-4062-ae9d-99f8707114b4" released by "_delete_snapshot" :: held 3.047s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:57:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-87ba60b5-e75e-45e1-b6e8-70d2c94d91e4 tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-27a5c786-ee6b-41bd-a501-5857e75cd647" released by "delete_snapshot" :: held 3.068s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:57:05 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=62,cinder:INSERT=21,cinder:UPDATE=68,cinder:DELETE=7 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:57:05 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=77,cinder:DELETE=6,cinder:SELECT=52,cinder:INSERT=19 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:57:05 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-87ba60b5-e75e-45e1-b6e8-70d2c94d91e4 tempest-ProjectReaderTests-162064681 None] Created reservations ['4713dd8b-b6d8-4eb8-8bcb-3c0bb2bdb2b0', '88114b63-dc07-4e5f-9226-211756e3aac3', '8abbddea-f5c9-4a05-a58e-e1a6ebfb9830', 'bcf43dd1-7e65-4698-9c5c-91b244d4347f'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:57:05 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-87ba60b5-e75e-45e1-b6e8-70d2c94d91e4 tempest-ProjectReaderTests-162064681 None] Delete snapshot completed successfully. Jul 08 14:57:05 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-87ba60b5-e75e-45e1-b6e8-70d2c94d91e4 tempest-ProjectReaderTests-162064681 None] Lock "cinder-9a93958b-e791-4062-ae9d-99f8707114b4-delete_snapshot" released by "delete_snapshot" :: held 3.212s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:57:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-86125fed-5c92-4a83-a55c-e9405e1eb0bb tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-27a5c786-ee6b-41bd-a501-5857e75cd647-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:57:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-86125fed-5c92-4a83-a55c-e9405e1eb0bb tempest-ProjectReaderTests-162064681 None] Lock "cinder-27a5c786-ee6b-41bd-a501-5857e75cd647-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:57:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-86125fed-5c92-4a83-a55c-e9405e1eb0bb tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-quobyte-27a5c786-ee6b-41bd-a501-5857e75cd647" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:57:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-86125fed-5c92-4a83-a55c-e9405e1eb0bb tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-27a5c786-ee6b-41bd-a501-5857e75cd647" acquired by "delete_volume" :: waited 0.013s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:57:06 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f4888c-b880-4bfc-8aea-d5e4b9048617]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:57:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-86125fed-5c92-4a83-a55c-e9405e1eb0bb tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:06 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647 Jul 08 14:57:06 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:07 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-86125fed-5c92-4a83-a55c-e9405e1eb0bb tempest-ProjectReaderTests-162064681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647" returned: 0 in 0.774s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-86125fed-5c92-4a83-a55c-e9405e1eb0bb tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:07 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647 Jul 08 14:57:07 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:07 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-86125fed-5c92-4a83-a55c-e9405e1eb0bb tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-27a5c786-ee6b-41bd-a501-5857e75cd647" returned: 0 in 0.642s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:07 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-86125fed-5c92-4a83-a55c-e9405e1eb0bb tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-27a5c786-ee6b-41bd-a501-5857e75cd647" released by "delete_volume" :: held 1.472s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:57:07 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-86125fed-5c92-4a83-a55c-e9405e1eb0bb tempest-ProjectReaderTests-162064681 None] Created reservations ['e8a481e7-126c-4a49-8989-4ba7a0da5c52', 'd2d2636c-6301-44b0-bf9c-49765119498e', 'b2466368-a51f-4a52-abba-9516ab867337', '33767533-7f0f-4f89-afa1-c07a4f47675b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:57:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-86125fed-5c92-4a83-a55c-e9405e1eb0bb tempest-ProjectReaderTests-162064681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:57:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-86125fed-5c92-4a83-a55c-e9405e1eb0bb tempest-ProjectReaderTests-162064681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:57:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-86125fed-5c92-4a83-a55c-e9405e1eb0bb tempest-ProjectReaderTests-162064681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:57:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-86125fed-5c92-4a83-a55c-e9405e1eb0bb tempest-ProjectReaderTests-162064681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:57:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-86125fed-5c92-4a83-a55c-e9405e1eb0bb tempest-ProjectReaderTests-162064681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:57:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-86125fed-5c92-4a83-a55c-e9405e1eb0bb tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:08 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:57:08 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:08 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-86125fed-5c92-4a83-a55c-e9405e1eb0bb tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.658s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:08 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-86125fed-5c92-4a83-a55c-e9405e1eb0bb tempest-ProjectReaderTests-162064681 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:57:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-86125fed-5c92-4a83-a55c-e9405e1eb0bb tempest-ProjectReaderTests-162064681 None] Deleted volume successfully. Jul 08 14:57:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-86125fed-5c92-4a83-a55c-e9405e1eb0bb tempest-ProjectReaderTests-162064681 None] Lock "cinder-27a5c786-ee6b-41bd-a501-5857e75cd647-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:57:09 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:57:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Flow 'volume_create_manager' (62d542a7-0520-498d-8ae7-68b61fa45819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:57:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4fcb1d-6675-479a-94a0-e0f977aef16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:57:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c4fcb1d-6675-479a-94a0-e0f977aef16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-220384113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25ed869be60d4956a3cb8a0bacfd17c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:57:09Z,use_quota=True,user_id='8176ee5185794fbc9ca064cb629d04d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:57:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913f007d-e238-46c9-b924-a57885a1ad6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:57:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913f007d-e238-46c9-b924-a57885a1ad6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:57:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773102fe-f2a7-4a31-a021-674303d65fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:57:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (773102fe-f2a7-4a31-a021-674303d65fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c', 'volume_name': 'volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:57:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f53b79-5e2d-4f3c-9706-1803dd6b86de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:57:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3f53b79-5e2d-4f3c-9706-1803dd6b86de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:57:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d05eec9e-5c9e-41f1-8030-5f868f17462e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:57:09 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Volume 6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c', 'volume_size': 1} Jul 08 14:57:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:57:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:57:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:57:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-220384113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25ed869be60d4956a3cb8a0bacfd17c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:57:09Z,use_quota=True,user_id='8176ee5185794fbc9ca064cb629d04d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:57:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Creating volume 6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:57:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:57:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:57:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:57:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:57:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:57:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:57:09 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:57:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:09 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c 1073741824 Jul 08 14:57:09 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:09 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c 1073741824" returned: 0 in 0.858s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:10 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c Jul 08 14:57:10 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:10 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c" returned: 0 in 0.664s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:57:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:57:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d05eec9e-5c9e-41f1-8030-5f868f17462e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:57:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b14877-313d-4719-9997-f00101eafaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:57:10 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Volume volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c (6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c): created successfully Jul 08 14:57:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b14877-313d-4719-9997-f00101eafaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:57:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Flow 'volume_create_manager' (62d542a7-0520-498d-8ae7-68b61fa45819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:57:10 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-90ff88a1-caaf-4401-8581-bb3907507625 tempest-ProjectReaderTests-162064681 None] Created volume successfully. Jul 08 14:57:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3f746464-8d8d-41b2-8f72-86b957e2e04a tempest-ProjectReaderTests-162064681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:57:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3f746464-8d8d-41b2-8f72-86b957e2e04a tempest-ProjectReaderTests-162064681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:57:11 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-3f746464-8d8d-41b2-8f72-86b957e2e04a tempest-ProjectReaderTests-162064681 None] Creating offline snapshot 024ec84e-82a1-4b14-a51a-48397cf34cd7 of volume 6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:57:11 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a9af2d-d6d5-4727-bf45-508e22b9d939]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:57:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3f746464-8d8d-41b2-8f72-86b957e2e04a tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:11 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c Jul 08 14:57:11 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:12 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3f746464-8d8d-41b2-8f72-86b957e2e04a tempest-ProjectReaderTests-162064681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c" returned: 0 in 0.787s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3f746464-8d8d-41b2-8f72-86b957e2e04a tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.024ec84e-82a1-4b14-a51a-48397cf34cd7 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:12 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.024ec84e-82a1-4b14-a51a-48397cf34cd7 1G Jul 08 14:57:12 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:12 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3f746464-8d8d-41b2-8f72-86b957e2e04a tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.024ec84e-82a1-4b14-a51a-48397cf34cd7 1G" returned: 0 in 0.816s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3f746464-8d8d-41b2-8f72-86b957e2e04a tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.024ec84e-82a1-4b14-a51a-48397cf34cd7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:12 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.024ec84e-82a1-4b14-a51a-48397cf34cd7 Jul 08 14:57:12 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:13 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3f746464-8d8d-41b2-8f72-86b957e2e04a tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.024ec84e-82a1-4b14-a51a-48397cf34cd7" returned: 0 in 0.715s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:13 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-3f746464-8d8d-41b2-8f72-86b957e2e04a tempest-ProjectReaderTests-162064681 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.024ec84e-82a1-4b14-a51a-48397cf34cd7 is being set with open permissions: ugo+rw Jul 08 14:57:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3f746464-8d8d-41b2-8f72-86b957e2e04a tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.024ec84e-82a1-4b14-a51a-48397cf34cd7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:13 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.024ec84e-82a1-4b14-a51a-48397cf34cd7 Jul 08 14:57:13 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:14 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3f746464-8d8d-41b2-8f72-86b957e2e04a tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.024ec84e-82a1-4b14-a51a-48397cf34cd7" returned: 0 in 0.688s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3f746464-8d8d-41b2-8f72-86b957e2e04a tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:14 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.info Jul 08 14:57:14 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:15 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3f746464-8d8d-41b2-8f72-86b957e2e04a tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.info" returned: 0 in 0.687s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:15 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-3f746464-8d8d-41b2-8f72-86b957e2e04a tempest-ProjectReaderTests-162064681 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.info is being set with open permissions: ugo+rw Jul 08 14:57:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3f746464-8d8d-41b2-8f72-86b957e2e04a tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:15 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.info Jul 08 14:57:15 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:15 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-3f746464-8d8d-41b2-8f72-86b957e2e04a tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.info" returned: 0 in 0.685s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-3f746464-8d8d-41b2-8f72-86b957e2e04a tempest-ProjectReaderTests-162064681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.459s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:57:15 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-3f746464-8d8d-41b2-8f72-86b957e2e04a tempest-ProjectReaderTests-162064681 None] Create snapshot completed successfully Jul 08 14:57:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-37beb2e9-0e79-4b57-8339-3040346b7b2e tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-024ec84e-82a1-4b14-a51a-48397cf34cd7-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:57:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-37beb2e9-0e79-4b57-8339-3040346b7b2e tempest-ProjectReaderTests-162064681 None] Lock "cinder-024ec84e-82a1-4b14-a51a-48397cf34cd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:57:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-37beb2e9-0e79-4b57-8339-3040346b7b2e tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-quobyte-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:57:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-37beb2e9-0e79-4b57-8339-3040346b7b2e tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:57:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-37beb2e9-0e79-4b57-8339-3040346b7b2e tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-quobyte-024ec84e-82a1-4b14-a51a-48397cf34cd7" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:57:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-37beb2e9-0e79-4b57-8339-3040346b7b2e tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-024ec84e-82a1-4b14-a51a-48397cf34cd7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:57:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-37beb2e9-0e79-4b57-8339-3040346b7b2e tempest-ProjectReaderTests-162064681 None] Deleting offline snapshot 024ec84e-82a1-4b14-a51a-48397cf34cd7 of volume 6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:57:16 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-37beb2e9-0e79-4b57-8339-3040346b7b2e tempest-ProjectReaderTests-162064681 None] snapshot_file for this snap is: volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.024ec84e-82a1-4b14-a51a-48397cf34cd7 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:57:16 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17b46f0-1fd1-4f84-8c13-d122458df7b6]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:57:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-37beb2e9-0e79-4b57-8339-3040346b7b2e tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.024ec84e-82a1-4b14-a51a-48397cf34cd7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:16 devstack sudo[108392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.024ec84e-82a1-4b14-a51a-48397cf34cd7 Jul 08 14:57:16 devstack sudo[108392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:17 devstack sudo[108392]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-37beb2e9-0e79-4b57-8339-3040346b7b2e tempest-ProjectReaderTests-162064681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.024ec84e-82a1-4b14-a51a-48397cf34cd7" returned: 0 in 0.725s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-37beb2e9-0e79-4b57-8339-3040346b7b2e tempest-ProjectReaderTests-162064681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:57:17 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25c76fa-c5c9-4fe7-a7ab-a0fe7c4836d4]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:57:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-37beb2e9-0e79-4b57-8339-3040346b7b2e tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:17 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c Jul 08 14:57:17 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:18 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-37beb2e9-0e79-4b57-8339-3040346b7b2e tempest-ProjectReaderTests-162064681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c" returned: 0 in 0.739s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-37beb2e9-0e79-4b57-8339-3040346b7b2e tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.024ec84e-82a1-4b14-a51a-48397cf34cd7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:18 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.024ec84e-82a1-4b14-a51a-48397cf34cd7 Jul 08 14:57:18 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:18 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-37beb2e9-0e79-4b57-8339-3040346b7b2e tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.024ec84e-82a1-4b14-a51a-48397cf34cd7" returned: 0 in 0.738s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-37beb2e9-0e79-4b57-8339-3040346b7b2e tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.024ec84e-82a1-4b14-a51a-48397cf34cd7 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:18 devstack sudo[108407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.024ec84e-82a1-4b14-a51a-48397cf34cd7 Jul 08 14:57:18 devstack sudo[108407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:19 devstack sudo[108407]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-37beb2e9-0e79-4b57-8339-3040346b7b2e tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c.024ec84e-82a1-4b14-a51a-48397cf34cd7" returned: 0 in 0.650s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-37beb2e9-0e79-4b57-8339-3040346b7b2e tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-024ec84e-82a1-4b14-a51a-48397cf34cd7" released by "_delete_snapshot" :: held 2.946s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:57:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-37beb2e9-0e79-4b57-8339-3040346b7b2e tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c" released by "delete_snapshot" :: held 2.968s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:57:19 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-37beb2e9-0e79-4b57-8339-3040346b7b2e tempest-ProjectReaderTests-162064681 None] Created reservations ['88833793-8529-4173-bef8-e14243bee2b2', '93879bfb-44c0-473f-8785-1f3438899715', '951cac1b-b601-451e-b2b8-7040bdd0f39e', '465e168b-60f8-4350-b29a-b74707a72ec7'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:57:19 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-37beb2e9-0e79-4b57-8339-3040346b7b2e tempest-ProjectReaderTests-162064681 None] Delete snapshot completed successfully. Jul 08 14:57:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-37beb2e9-0e79-4b57-8339-3040346b7b2e tempest-ProjectReaderTests-162064681 None] Lock "cinder-024ec84e-82a1-4b14-a51a-48397cf34cd7-delete_snapshot" released by "delete_snapshot" :: held 3.131s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:57:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fde609f2-fa32-4028-b662-1b378c15f75b tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:57:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fde609f2-fa32-4028-b662-1b378c15f75b tempest-ProjectReaderTests-162064681 None] Lock "cinder-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:57:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fde609f2-fa32-4028-b662-1b378c15f75b tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-quobyte-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:57:19 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fde609f2-fa32-4028-b662-1b378c15f75b tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:57:19 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[79794906-44a4-44ac-8252-ec70ec1dadaf]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:57:19 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fde609f2-fa32-4028-b662-1b378c15f75b tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:19 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c Jul 08 14:57:19 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:20 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fde609f2-fa32-4028-b662-1b378c15f75b tempest-ProjectReaderTests-162064681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c" returned: 0 in 0.736s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:20 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fde609f2-fa32-4028-b662-1b378c15f75b tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:20 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c Jul 08 14:57:20 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:21 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fde609f2-fa32-4028-b662-1b378c15f75b tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c" returned: 0 in 0.611s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fde609f2-fa32-4028-b662-1b378c15f75b tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c" released by "delete_volume" :: held 1.399s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:57:21 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-fde609f2-fa32-4028-b662-1b378c15f75b tempest-ProjectReaderTests-162064681 None] Created reservations ['a0d07f01-3fe7-4dea-820a-df4df5590bac', '6e79867e-cffd-4ac8-8412-46f39c21513d', '85fb74a2-b311-4caf-9583-4002487cf7b5', '92f53c74-6a0f-4780-b777-3da31cf78804'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:57:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fde609f2-fa32-4028-b662-1b378c15f75b tempest-ProjectReaderTests-162064681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:57:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fde609f2-fa32-4028-b662-1b378c15f75b tempest-ProjectReaderTests-162064681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:57:21 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fde609f2-fa32-4028-b662-1b378c15f75b tempest-ProjectReaderTests-162064681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:57:21 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-fde609f2-fa32-4028-b662-1b378c15f75b tempest-ProjectReaderTests-162064681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:57:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-fde609f2-fa32-4028-b662-1b378c15f75b tempest-ProjectReaderTests-162064681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:57:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fde609f2-fa32-4028-b662-1b378c15f75b tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:21 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:57:21 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:21 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:21 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-fde609f2-fa32-4028-b662-1b378c15f75b tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.618s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:21 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-fde609f2-fa32-4028-b662-1b378c15f75b tempest-ProjectReaderTests-162064681 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:57:21 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-fde609f2-fa32-4028-b662-1b378c15f75b tempest-ProjectReaderTests-162064681 None] Deleted volume successfully. Jul 08 14:57:21 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-fde609f2-fa32-4028-b662-1b378c15f75b tempest-ProjectReaderTests-162064681 None] Lock "cinder-6b2650b3-f3cc-4fde-bb4e-3174dd2ab34c-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:57:22 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:57:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Flow 'volume_create_manager' (60fb3c09-f7df-4485-8a76-25f385f88851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:57:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e73cfb9a-bdad-4dfb-9684-3c5fce7a4897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:57:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e73cfb9a-bdad-4dfb-9684-3c5fce7a4897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1972901945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d52d66-553f-4cd9-b3c0-d6908da8ced1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25ed869be60d4956a3cb8a0bacfd17c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:57:22Z,use_quota=True,user_id='8176ee5185794fbc9ca064cb629d04d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:57:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637a4735-4b40-445f-97d0-7dc4d5f2e9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:57:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637a4735-4b40-445f-97d0-7dc4d5f2e9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:57:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8358d0b7-5e9f-46b8-bdfd-a1493111f1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:57:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8358d0b7-5e9f-46b8-bdfd-a1493111f1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3d52d66-553f-4cd9-b3c0-d6908da8ced1', 'volume_name': 'volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:57:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6559b6a1-012e-46c2-9734-03cd135c889b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:57:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6559b6a1-012e-46c2-9734-03cd135c889b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:57:22 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a350f4-c2e7-4136-804c-b67a2d8a4934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:57:22 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Volume a3d52d66-553f-4cd9-b3c0-d6908da8ced1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1', 'volume_size': 1} Jul 08 14:57:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:57:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:57:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:57:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1972901945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d52d66-553f-4cd9-b3c0-d6908da8ced1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25ed869be60d4956a3cb8a0bacfd17c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:57:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:57:22Z,use_quota=True,user_id='8176ee5185794fbc9ca064cb629d04d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:57:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Creating volume a3d52d66-553f-4cd9-b3c0-d6908da8ced1 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:57:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:57:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:57:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:57:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:57:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:57:22 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:57:22 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:57:22 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:22 devstack sudo[108422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1 1073741824 Jul 08 14:57:22 devstack sudo[108422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:23 devstack sudo[108422]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1 1073741824" returned: 0 in 0.775s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:23 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1 Jul 08 14:57:23 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:23 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1" returned: 0 in 0.612s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:23 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:57:23 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:57:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a350f4-c2e7-4136-804c-b67a2d8a4934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:57:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (867eca5a-c8a4-4379-84aa-b77e63b7af5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:57:23 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Volume volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1 (a3d52d66-553f-4cd9-b3c0-d6908da8ced1): created successfully Jul 08 14:57:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (867eca5a-c8a4-4379-84aa-b77e63b7af5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:57:23 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Flow 'volume_create_manager' (60fb3c09-f7df-4485-8a76-25f385f88851) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:57:23 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-4d1412c4-f468-4ba6-a3e3-c080c5f39149 tempest-ProjectReaderTests-162064681 None] Created volume successfully. Jul 08 14:57:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-019ef09d-037b-4125-8f40-ae726104b598 tempest-ProjectReaderTests-162064681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:57:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-019ef09d-037b-4125-8f40-ae726104b598 tempest-ProjectReaderTests-162064681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:57:24 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-019ef09d-037b-4125-8f40-ae726104b598 tempest-ProjectReaderTests-162064681 None] Creating offline snapshot bbe73b63-19e8-4948-8433-a1565eaf46f5 of volume a3d52d66-553f-4cd9-b3c0-d6908da8ced1 {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:57:24 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb413f5-ff99-4ddc-a2c0-96ed98b16503]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:57:24 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-019ef09d-037b-4125-8f40-ae726104b598 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:24 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1 Jul 08 14:57:24 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:25 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-019ef09d-037b-4125-8f40-ae726104b598 tempest-ProjectReaderTests-162064681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1" returned: 0 in 0.727s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:25 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-019ef09d-037b-4125-8f40-ae726104b598 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.bbe73b63-19e8-4948-8433-a1565eaf46f5 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:25 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.bbe73b63-19e8-4948-8433-a1565eaf46f5 1G Jul 08 14:57:25 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:25 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-019ef09d-037b-4125-8f40-ae726104b598 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.bbe73b63-19e8-4948-8433-a1565eaf46f5 1G" returned: 0 in 0.738s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-019ef09d-037b-4125-8f40-ae726104b598 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.bbe73b63-19e8-4948-8433-a1565eaf46f5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:26 devstack sudo[108441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.bbe73b63-19e8-4948-8433-a1565eaf46f5 Jul 08 14:57:26 devstack sudo[108441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:26 devstack sudo[108441]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-019ef09d-037b-4125-8f40-ae726104b598 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1 -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.bbe73b63-19e8-4948-8433-a1565eaf46f5" returned: 0 in 0.648s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:26 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-019ef09d-037b-4125-8f40-ae726104b598 tempest-ProjectReaderTests-162064681 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.bbe73b63-19e8-4948-8433-a1565eaf46f5 is being set with open permissions: ugo+rw Jul 08 14:57:26 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-019ef09d-037b-4125-8f40-ae726104b598 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.bbe73b63-19e8-4948-8433-a1565eaf46f5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:26 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.bbe73b63-19e8-4948-8433-a1565eaf46f5 Jul 08 14:57:26 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:27 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-019ef09d-037b-4125-8f40-ae726104b598 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.bbe73b63-19e8-4948-8433-a1565eaf46f5" returned: 0 in 0.613s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-019ef09d-037b-4125-8f40-ae726104b598 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:27 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.info Jul 08 14:57:27 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:27 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-019ef09d-037b-4125-8f40-ae726104b598 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.info" returned: 0 in 0.615s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:27 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-019ef09d-037b-4125-8f40-ae726104b598 tempest-ProjectReaderTests-162064681 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.info is being set with open permissions: ugo+rw Jul 08 14:57:27 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-019ef09d-037b-4125-8f40-ae726104b598 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:27 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.info Jul 08 14:57:27 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:28 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-019ef09d-037b-4125-8f40-ae726104b598 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.info" returned: 0 in 0.632s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:28 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-019ef09d-037b-4125-8f40-ae726104b598 tempest-ProjectReaderTests-162064681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.053s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:57:28 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-019ef09d-037b-4125-8f40-ae726104b598 tempest-ProjectReaderTests-162064681 None] Create snapshot completed successfully Jul 08 14:57:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1378bc7c-2feb-41ce-99ce-e480ff3b316c tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-bbe73b63-19e8-4948-8433-a1565eaf46f5-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:57:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1378bc7c-2feb-41ce-99ce-e480ff3b316c tempest-ProjectReaderTests-162064681 None] Lock "cinder-bbe73b63-19e8-4948-8433-a1565eaf46f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:57:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1378bc7c-2feb-41ce-99ce-e480ff3b316c tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-quobyte-a3d52d66-553f-4cd9-b3c0-d6908da8ced1" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:57:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1378bc7c-2feb-41ce-99ce-e480ff3b316c tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-a3d52d66-553f-4cd9-b3c0-d6908da8ced1" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:57:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1378bc7c-2feb-41ce-99ce-e480ff3b316c tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-quobyte-bbe73b63-19e8-4948-8433-a1565eaf46f5" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:57:29 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1378bc7c-2feb-41ce-99ce-e480ff3b316c tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-bbe73b63-19e8-4948-8433-a1565eaf46f5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:57:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-1378bc7c-2feb-41ce-99ce-e480ff3b316c tempest-ProjectReaderTests-162064681 None] Deleting offline snapshot bbe73b63-19e8-4948-8433-a1565eaf46f5 of volume a3d52d66-553f-4cd9-b3c0-d6908da8ced1 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:57:29 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-1378bc7c-2feb-41ce-99ce-e480ff3b316c tempest-ProjectReaderTests-162064681 None] snapshot_file for this snap is: volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.bbe73b63-19e8-4948-8433-a1565eaf46f5 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:57:29 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[68daf1f0-c0d6-447e-8ac8-20d94f291bc5]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:57:29 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1378bc7c-2feb-41ce-99ce-e480ff3b316c tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.bbe73b63-19e8-4948-8433-a1565eaf46f5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:29 devstack sudo[108455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.bbe73b63-19e8-4948-8433-a1565eaf46f5 Jul 08 14:57:29 devstack sudo[108455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:30 devstack sudo[108455]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1378bc7c-2feb-41ce-99ce-e480ff3b316c tempest-ProjectReaderTests-162064681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.bbe73b63-19e8-4948-8433-a1565eaf46f5" returned: 0 in 0.720s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:30 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-1378bc7c-2feb-41ce-99ce-e480ff3b316c tempest-ProjectReaderTests-162064681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:57:30 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f60c047-62fb-424d-a04b-ce3777c972ef]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:57:30 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1378bc7c-2feb-41ce-99ce-e480ff3b316c tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:30 devstack sudo[108460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1 Jul 08 14:57:30 devstack sudo[108460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:31 devstack sudo[108460]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1378bc7c-2feb-41ce-99ce-e480ff3b316c tempest-ProjectReaderTests-162064681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1" returned: 0 in 0.707s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1378bc7c-2feb-41ce-99ce-e480ff3b316c tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.bbe73b63-19e8-4948-8433-a1565eaf46f5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:31 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.bbe73b63-19e8-4948-8433-a1565eaf46f5 Jul 08 14:57:31 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:31 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1378bc7c-2feb-41ce-99ce-e480ff3b316c tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.bbe73b63-19e8-4948-8433-a1565eaf46f5" returned: 0 in 0.690s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:31 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1378bc7c-2feb-41ce-99ce-e480ff3b316c tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.bbe73b63-19e8-4948-8433-a1565eaf46f5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:31 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.bbe73b63-19e8-4948-8433-a1565eaf46f5 Jul 08 14:57:31 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:32 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-1378bc7c-2feb-41ce-99ce-e480ff3b316c tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1.bbe73b63-19e8-4948-8433-a1565eaf46f5" returned: 0 in 0.610s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1378bc7c-2feb-41ce-99ce-e480ff3b316c tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-bbe73b63-19e8-4948-8433-a1565eaf46f5" released by "_delete_snapshot" :: held 2.811s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:57:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1378bc7c-2feb-41ce-99ce-e480ff3b316c tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-a3d52d66-553f-4cd9-b3c0-d6908da8ced1" released by "delete_snapshot" :: held 2.833s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:57:32 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-1378bc7c-2feb-41ce-99ce-e480ff3b316c tempest-ProjectReaderTests-162064681 None] Created reservations ['8d518650-0fd0-4530-8c26-ea55b9af6da4', '30e2d35d-5b7c-485b-95d4-9f9c426b5590', '17037260-4061-4de2-b532-4d8761c42231', '870587b8-9faa-43ef-9018-5cb78fa2c2db'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:57:32 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-1378bc7c-2feb-41ce-99ce-e480ff3b316c tempest-ProjectReaderTests-162064681 None] Delete snapshot completed successfully. Jul 08 14:57:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-1378bc7c-2feb-41ce-99ce-e480ff3b316c tempest-ProjectReaderTests-162064681 None] Lock "cinder-bbe73b63-19e8-4948-8433-a1565eaf46f5-delete_snapshot" released by "delete_snapshot" :: held 2.962s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:57:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f8fb869c-143d-4c3b-aeba-2a3570ddf3d7 tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-a3d52d66-553f-4cd9-b3c0-d6908da8ced1-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:57:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f8fb869c-143d-4c3b-aeba-2a3570ddf3d7 tempest-ProjectReaderTests-162064681 None] Lock "cinder-a3d52d66-553f-4cd9-b3c0-d6908da8ced1-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:57:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f8fb869c-143d-4c3b-aeba-2a3570ddf3d7 tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-quobyte-a3d52d66-553f-4cd9-b3c0-d6908da8ced1" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:57:32 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f8fb869c-143d-4c3b-aeba-2a3570ddf3d7 tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-a3d52d66-553f-4cd9-b3c0-d6908da8ced1" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:57:32 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[9076ec6a-c8c6-46a1-ab6d-14a13c53a29c]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:57:32 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f8fb869c-143d-4c3b-aeba-2a3570ddf3d7 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:33 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1 Jul 08 14:57:33 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:33 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f8fb869c-143d-4c3b-aeba-2a3570ddf3d7 tempest-ProjectReaderTests-162064681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1" returned: 0 in 0.726s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:33 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f8fb869c-143d-4c3b-aeba-2a3570ddf3d7 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:33 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1 Jul 08 14:57:33 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:34 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f8fb869c-143d-4c3b-aeba-2a3570ddf3d7 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-a3d52d66-553f-4cd9-b3c0-d6908da8ced1" returned: 0 in 0.610s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:34 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f8fb869c-143d-4c3b-aeba-2a3570ddf3d7 tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-a3d52d66-553f-4cd9-b3c0-d6908da8ced1" released by "delete_volume" :: held 1.386s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:57:34 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-f8fb869c-143d-4c3b-aeba-2a3570ddf3d7 tempest-ProjectReaderTests-162064681 None] Created reservations ['172f36db-7ae1-453a-87d2-72fcf4ba6359', '05c30545-db63-4fe3-90d2-a3342e4b40de', '4756bd12-a7a1-437c-a20d-8c0d1a3ddd2d', '4e6086e8-420f-4c14-8877-dbe0d78e362b'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:57:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f8fb869c-143d-4c3b-aeba-2a3570ddf3d7 tempest-ProjectReaderTests-162064681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:57:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f8fb869c-143d-4c3b-aeba-2a3570ddf3d7 tempest-ProjectReaderTests-162064681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:57:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f8fb869c-143d-4c3b-aeba-2a3570ddf3d7 tempest-ProjectReaderTests-162064681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:57:34 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f8fb869c-143d-4c3b-aeba-2a3570ddf3d7 tempest-ProjectReaderTests-162064681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:57:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f8fb869c-143d-4c3b-aeba-2a3570ddf3d7 tempest-ProjectReaderTests-162064681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:57:34 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f8fb869c-143d-4c3b-aeba-2a3570ddf3d7 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:34 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:57:34 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:35 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f8fb869c-143d-4c3b-aeba-2a3570ddf3d7 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.623s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-f8fb869c-143d-4c3b-aeba-2a3570ddf3d7 tempest-ProjectReaderTests-162064681 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:57:35 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f8fb869c-143d-4c3b-aeba-2a3570ddf3d7 tempest-ProjectReaderTests-162064681 None] Deleted volume successfully. Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f8fb869c-143d-4c3b-aeba-2a3570ddf3d7 tempest-ProjectReaderTests-162064681 None] Lock "cinder-a3d52d66-553f-4cd9-b3c0-d6908da8ced1-delete_volume" released by "delete_volume" :: held 2.193s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Flow 'volume_create_manager' (bbfe7c72-29a6-495a-afa7-c5fa6a4524ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28228a38-f283-4611-a70c-a025f65acdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28228a38-f283-4611-a70c-a025f65acdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1672726931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e508adb7-e119-474f-9148-a763a76058fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25ed869be60d4956a3cb8a0bacfd17c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:57:35Z,use_quota=True,user_id='8176ee5185794fbc9ca064cb629d04d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3d767f-994f-4bc8-b4a0-065ab51c41c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3d767f-994f-4bc8-b4a0-065ab51c41c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb23d38e-7a7c-4361-837a-06dc0d7ba88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb23d38e-7a7c-4361-837a-06dc0d7ba88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e508adb7-e119-474f-9148-a763a76058fd', 'volume_name': 'volume-e508adb7-e119-474f-9148-a763a76058fd', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d76c3ef-6c78-44eb-987e-7e3dbc7680f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d76c3ef-6c78-44eb-987e-7e3dbc7680f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf21e71c-e9ba-45b4-8344-fedacb623bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:57:35 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Volume e508adb7-e119-474f-9148-a763a76058fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e508adb7-e119-474f-9148-a763a76058fd', 'volume_size': 1} Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1672726931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e508adb7-e119-474f-9148-a763a76058fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25ed869be60d4956a3cb8a0bacfd17c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:57:35Z,use_quota=True,user_id='8176ee5185794fbc9ca064cb629d04d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Creating volume e508adb7-e119-474f-9148-a763a76058fd {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:57:35 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:57:35 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:35 devstack sudo[108485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd 1073741824 Jul 08 14:57:35 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:36 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd 1073741824" returned: 0 in 0.769s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:36 devstack sudo[108490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd Jul 08 14:57:36 devstack sudo[108490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:36 devstack sudo[108490]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd" returned: 0 in 0.619s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:36 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:57:36 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:57:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf21e71c-e9ba-45b4-8344-fedacb623bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e508adb7-e119-474f-9148-a763a76058fd', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:57:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9110995-1d26-4336-85ac-8846491384b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:57:37 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Volume volume-e508adb7-e119-474f-9148-a763a76058fd (e508adb7-e119-474f-9148-a763a76058fd): created successfully Jul 08 14:57:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9110995-1d26-4336-85ac-8846491384b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:57:37 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Flow 'volume_create_manager' (bbfe7c72-29a6-495a-afa7-c5fa6a4524ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:57:37 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-7f1619ec-d982-4d29-866a-7faa45067f01 tempest-ProjectReaderTests-162064681 None] Created volume successfully. Jul 08 14:57:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8735c946-f357-4f78-9e3d-478e969a6d1b tempest-ProjectReaderTests-162064681 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:57:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8735c946-f357-4f78-9e3d-478e969a6d1b tempest-ProjectReaderTests-162064681 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:57:37 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-8735c946-f357-4f78-9e3d-478e969a6d1b tempest-ProjectReaderTests-162064681 None] Creating offline snapshot 0465ced8-af2d-4f62-9fbc-2c876ee83ab5 of volume e508adb7-e119-474f-9148-a763a76058fd {{(pid=87240) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 14:57:37 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b220f1-64b7-42a6-b074-c0a6d6295951]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:57:37 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8735c946-f357-4f78-9e3d-478e969a6d1b tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:37 devstack sudo[108493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd Jul 08 14:57:37 devstack sudo[108493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:38 devstack sudo[108493]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8735c946-f357-4f78-9e3d-478e969a6d1b tempest-ProjectReaderTests-162064681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd" returned: 0 in 0.720s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:38 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8735c946-f357-4f78-9e3d-478e969a6d1b tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.0465ced8-af2d-4f62-9fbc-2c876ee83ab5 1G {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:38 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.0465ced8-af2d-4f62-9fbc-2c876ee83ab5 1G Jul 08 14:57:38 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:39 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8735c946-f357-4f78-9e3d-478e969a6d1b tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.0465ced8-af2d-4f62-9fbc-2c876ee83ab5 1G" returned: 0 in 0.754s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8735c946-f357-4f78-9e3d-478e969a6d1b tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e508adb7-e119-474f-9148-a763a76058fd -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.0465ced8-af2d-4f62-9fbc-2c876ee83ab5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:39 devstack sudo[108503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e508adb7-e119-474f-9148-a763a76058fd -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.0465ced8-af2d-4f62-9fbc-2c876ee83ab5 Jul 08 14:57:39 devstack sudo[108503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:39 devstack sudo[108503]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8735c946-f357-4f78-9e3d-478e969a6d1b tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e508adb7-e119-474f-9148-a763a76058fd -F qcow2 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.0465ced8-af2d-4f62-9fbc-2c876ee83ab5" returned: 0 in 0.725s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:39 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-8735c946-f357-4f78-9e3d-478e969a6d1b tempest-ProjectReaderTests-162064681 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.0465ced8-af2d-4f62-9fbc-2c876ee83ab5 is being set with open permissions: ugo+rw Jul 08 14:57:39 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8735c946-f357-4f78-9e3d-478e969a6d1b tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.0465ced8-af2d-4f62-9fbc-2c876ee83ab5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:39 devstack sudo[108508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.0465ced8-af2d-4f62-9fbc-2c876ee83ab5 Jul 08 14:57:39 devstack sudo[108508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:40 devstack sudo[108508]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8735c946-f357-4f78-9e3d-478e969a6d1b tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.0465ced8-af2d-4f62-9fbc-2c876ee83ab5" returned: 0 in 0.611s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:40 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8735c946-f357-4f78-9e3d-478e969a6d1b tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:40 devstack sudo[108511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.info Jul 08 14:57:40 devstack sudo[108511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:41 devstack sudo[108511]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8735c946-f357-4f78-9e3d-478e969a6d1b tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.info" returned: 0 in 0.617s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:41 devstack cinder-volume[87240]: WARNING cinder.volume.drivers.remotefs [None req-8735c946-f357-4f78-9e3d-478e969a6d1b tempest-ProjectReaderTests-162064681 None] /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.info is being set with open permissions: ugo+rw Jul 08 14:57:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8735c946-f357-4f78-9e3d-478e969a6d1b tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.info {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:41 devstack sudo[108514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.info Jul 08 14:57:41 devstack sudo[108514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:41 devstack sudo[108514]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-8735c946-f357-4f78-9e3d-478e969a6d1b tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.info" returned: 0 in 0.600s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:41 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-8735c946-f357-4f78-9e3d-478e969a6d1b tempest-ProjectReaderTests-162064681 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.107s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:57:41 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-8735c946-f357-4f78-9e3d-478e969a6d1b tempest-ProjectReaderTests-162064681 None] Create snapshot completed successfully Jul 08 14:57:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c48c26a-e3f7-43b3-825b-675620d5d1ce tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-0465ced8-af2d-4f62-9fbc-2c876ee83ab5-delete_snapshot" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:57:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c48c26a-e3f7-43b3-825b-675620d5d1ce tempest-ProjectReaderTests-162064681 None] Lock "cinder-0465ced8-af2d-4f62-9fbc-2c876ee83ab5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:57:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c48c26a-e3f7-43b3-825b-675620d5d1ce tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-quobyte-e508adb7-e119-474f-9148-a763a76058fd" by "delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:57:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c48c26a-e3f7-43b3-825b-675620d5d1ce tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-e508adb7-e119-474f-9148-a763a76058fd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:57:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c48c26a-e3f7-43b3-825b-675620d5d1ce tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-quobyte-0465ced8-af2d-4f62-9fbc-2c876ee83ab5" by "_delete_snapshot" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:57:42 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c48c26a-e3f7-43b3-825b-675620d5d1ce tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-0465ced8-af2d-4f62-9fbc-2c876ee83ab5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:57:42 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9c48c26a-e3f7-43b3-825b-675620d5d1ce tempest-ProjectReaderTests-162064681 None] Deleting offline snapshot 0465ced8-af2d-4f62-9fbc-2c876ee83ab5 of volume e508adb7-e119-474f-9148-a763a76058fd {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 14:57:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9c48c26a-e3f7-43b3-825b-675620d5d1ce tempest-ProjectReaderTests-162064681 None] snapshot_file for this snap is: volume-e508adb7-e119-474f-9148-a763a76058fd.0465ced8-af2d-4f62-9fbc-2c876ee83ab5 {{(pid=87240) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 14:57:43 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfcb32e-4e8f-496f-abe6-7809c533cd9f]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:57:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c48c26a-e3f7-43b3-825b-675620d5d1ce tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.0465ced8-af2d-4f62-9fbc-2c876ee83ab5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:43 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.0465ced8-af2d-4f62-9fbc-2c876ee83ab5 Jul 08 14:57:43 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:43 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c48c26a-e3f7-43b3-825b-675620d5d1ce tempest-ProjectReaderTests-162064681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.0465ced8-af2d-4f62-9fbc-2c876ee83ab5" returned: 0 in 0.716s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:43 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-9c48c26a-e3f7-43b3-825b-675620d5d1ce tempest-ProjectReaderTests-162064681 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e508adb7-e119-474f-9148-a763a76058fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87240) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 14:57:43 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[652a42ac-bc41-456b-9c35-df1284a1c501]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:57:43 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c48c26a-e3f7-43b3-825b-675620d5d1ce tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:43 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd Jul 08 14:57:43 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:44 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c48c26a-e3f7-43b3-825b-675620d5d1ce tempest-ProjectReaderTests-162064681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd" returned: 0 in 0.710s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:44 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c48c26a-e3f7-43b3-825b-675620d5d1ce tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.0465ced8-af2d-4f62-9fbc-2c876ee83ab5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:44 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.0465ced8-af2d-4f62-9fbc-2c876ee83ab5 Jul 08 14:57:44 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:45 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c48c26a-e3f7-43b3-825b-675620d5d1ce tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.0465ced8-af2d-4f62-9fbc-2c876ee83ab5" returned: 0 in 0.688s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c48c26a-e3f7-43b3-825b-675620d5d1ce tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.0465ced8-af2d-4f62-9fbc-2c876ee83ab5 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:45 devstack sudo[108534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.0465ced8-af2d-4f62-9fbc-2c876ee83ab5 Jul 08 14:57:45 devstack sudo[108534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:45 devstack sudo[108534]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:45 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-9c48c26a-e3f7-43b3-825b-675620d5d1ce tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd.0465ced8-af2d-4f62-9fbc-2c876ee83ab5" returned: 0 in 0.607s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c48c26a-e3f7-43b3-825b-675620d5d1ce tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-0465ced8-af2d-4f62-9fbc-2c876ee83ab5" released by "_delete_snapshot" :: held 2.803s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:57:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c48c26a-e3f7-43b3-825b-675620d5d1ce tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-e508adb7-e119-474f-9148-a763a76058fd" released by "delete_snapshot" :: held 2.825s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:57:45 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-9c48c26a-e3f7-43b3-825b-675620d5d1ce tempest-ProjectReaderTests-162064681 None] Created reservations ['554e4b7f-038d-4f0f-80b9-e47f8df497bf', '23802657-037c-481f-818e-cc01111c10ab', '2205553b-7a8e-4524-a049-59beb3164724', '6f047fd6-449d-4b2e-bdea-b43c45aaa820'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:57:45 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-9c48c26a-e3f7-43b3-825b-675620d5d1ce tempest-ProjectReaderTests-162064681 None] Delete snapshot completed successfully. Jul 08 14:57:45 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-9c48c26a-e3f7-43b3-825b-675620d5d1ce tempest-ProjectReaderTests-162064681 None] Lock "cinder-0465ced8-af2d-4f62-9fbc-2c876ee83ab5-delete_snapshot" released by "delete_snapshot" :: held 2.946s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:57:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f369a504-2104-48b5-a14c-cb64fcc3d03f tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-e508adb7-e119-474f-9148-a763a76058fd-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:57:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f369a504-2104-48b5-a14c-cb64fcc3d03f tempest-ProjectReaderTests-162064681 None] Lock "cinder-e508adb7-e119-474f-9148-a763a76058fd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:57:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f369a504-2104-48b5-a14c-cb64fcc3d03f tempest-ProjectReaderTests-162064681 None] Acquiring lock "cinder-quobyte-e508adb7-e119-474f-9148-a763a76058fd" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:57:46 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f369a504-2104-48b5-a14c-cb64fcc3d03f tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-e508adb7-e119-474f-9148-a763a76058fd" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:57:46 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8ec3ec-6d37-4d65-9105-e96094e5eb90]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:57:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f369a504-2104-48b5-a14c-cb64fcc3d03f tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:46 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd Jul 08 14:57:46 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:46 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f369a504-2104-48b5-a14c-cb64fcc3d03f tempest-ProjectReaderTests-162064681 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd" returned: 0 in 0.716s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:46 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f369a504-2104-48b5-a14c-cb64fcc3d03f tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:46 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd Jul 08 14:57:46 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:47 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f369a504-2104-48b5-a14c-cb64fcc3d03f tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e508adb7-e119-474f-9148-a763a76058fd" returned: 0 in 0.608s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:47 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f369a504-2104-48b5-a14c-cb64fcc3d03f tempest-ProjectReaderTests-162064681 None] Lock "cinder-quobyte-e508adb7-e119-474f-9148-a763a76058fd" released by "delete_volume" :: held 1.378s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:57:47 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-f369a504-2104-48b5-a14c-cb64fcc3d03f tempest-ProjectReaderTests-162064681 None] Created reservations ['36b0a463-ab58-4073-96b4-6b14eef6f61f', '1406b778-0670-40c3-abe6-35a59b842b02', '26bc79c1-6650-4f05-8b52-e441e83beb26', '9f2f4768-47be-45cb-98e2-59fde56162ac'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:57:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f369a504-2104-48b5-a14c-cb64fcc3d03f tempest-ProjectReaderTests-162064681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:57:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f369a504-2104-48b5-a14c-cb64fcc3d03f tempest-ProjectReaderTests-162064681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:57:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f369a504-2104-48b5-a14c-cb64fcc3d03f tempest-ProjectReaderTests-162064681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:57:47 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-f369a504-2104-48b5-a14c-cb64fcc3d03f tempest-ProjectReaderTests-162064681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:57:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-f369a504-2104-48b5-a14c-cb64fcc3d03f tempest-ProjectReaderTests-162064681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:57:47 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f369a504-2104-48b5-a14c-cb64fcc3d03f tempest-ProjectReaderTests-162064681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:47 devstack sudo[108545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:57:47 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:48 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root Jul 08 14:57:48 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-f369a504-2104-48b5-a14c-cb64fcc3d03f tempest-ProjectReaderTests-162064681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.616s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:57:48 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-f369a504-2104-48b5-a14c-cb64fcc3d03f tempest-ProjectReaderTests-162064681 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:57:48 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-f369a504-2104-48b5-a14c-cb64fcc3d03f tempest-ProjectReaderTests-162064681 None] Deleted volume successfully. Jul 08 14:57:48 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-f369a504-2104-48b5-a14c-cb64fcc3d03f tempest-ProjectReaderTests-162064681 None] Lock "cinder-e508adb7-e119-474f-9148-a763a76058fd-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:57:57 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=58,cinder:INSERT=16,cinder:UPDATE=70,cinder:DELETE=5 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:57:58 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:INSERT=22,cinder:UPDATE=66,cinder:SELECT=44,cinder:DELETE=5 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:59 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:57:59 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Flow 'volume_create_manager' (f3338b63-e437-4110-9393-95523fc3cee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5788520-6d3e-4c74-a454-78494a031064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5788520-6d3e-4c74-a454-78494a031064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2144982142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99855eb-f5f2-4f0e-afbf-427de055220b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d686b295b31a491f823fdab32e6127e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:58:00Z,use_quota=True,user_id='89a9d0de6c634441b8762fbe7b74d1e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d33465-5ed4-4046-90cb-cee0cb199fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d33465-5ed4-4046-90cb-cee0cb199fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca1da673-441a-481e-84dc-1e60c92cf306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca1da673-441a-481e-84dc-1e60c92cf306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f99855eb-f5f2-4f0e-afbf-427de055220b', 'volume_name': 'volume-f99855eb-f5f2-4f0e-afbf-427de055220b', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e34e73-86b8-4d87-ae73-4ac89d340ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41e34e73-86b8-4d87-ae73-4ac89d340ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b64320d-c9bb-41a0-a5ba-75067ab76c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:57:59 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Volume f99855eb-f5f2-4f0e-afbf-427de055220b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f99855eb-f5f2-4f0e-afbf-427de055220b', 'volume_size': 1} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:57:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2144982142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99855eb-f5f2-4f0e-afbf-427de055220b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d686b295b31a491f823fdab32e6127e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:58:00Z,use_quota=True,user_id='89a9d0de6c634441b8762fbe7b74d1e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Creating volume f99855eb-f5f2-4f0e-afbf-427de055220b {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:57:59 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:57:59 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f99855eb-f5f2-4f0e-afbf-427de055220b 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:57:59 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f99855eb-f5f2-4f0e-afbf-427de055220b 1073741824 Jul 08 14:57:59 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:57:59 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Jul 08 14:58:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.631s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:58:00 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:58:00 devstack cinder-volume[87240]: DEBUG oslo_service.periodic_task [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] Running periodic task VolumeManager._thread_info {{(pid=87240) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 14:58:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread count: 28 {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 14:58:00 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-eeab71e5-3a30-4784-841c-0181fe2084c6 None None] thread info: [<_MainThread(MainThread, started 134096800571520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87240) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 14:58:00 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Jul 08 14:58:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f99855eb-f5f2-4f0e-afbf-427de055220b 1073741824" returned: 0 in 0.800s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:58:00 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f99855eb-f5f2-4f0e-afbf-427de055220b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:58:00 devstack sudo[108604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f99855eb-f5f2-4f0e-afbf-427de055220b Jul 08 14:58:00 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:58:01 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root Jul 08 14:58:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f99855eb-f5f2-4f0e-afbf-427de055220b" returned: 0 in 0.598s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:58:01 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:58:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:58:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b64320d-c9bb-41a0-a5ba-75067ab76c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f99855eb-f5f2-4f0e-afbf-427de055220b', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:58:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012251d7-1da4-400a-9826-917f5504c6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:58:01 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Volume volume-f99855eb-f5f2-4f0e-afbf-427de055220b (f99855eb-f5f2-4f0e-afbf-427de055220b): created successfully Jul 08 14:58:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012251d7-1da4-400a-9826-917f5504c6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:58:01 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Flow 'volume_create_manager' (f3338b63-e437-4110-9393-95523fc3cee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:58:01 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-741abad3-db03-42c2-88ea-c175d3936455 tempest-ProjectReaderTests-1887482355 None] Created volume successfully. Jul 08 14:58:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d27f0334-c3ec-4c38-a141-e16e81203bb6 tempest-ProjectReaderTests-1887482355 None] Acquiring lock "cinder-f99855eb-f5f2-4f0e-afbf-427de055220b-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:58:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d27f0334-c3ec-4c38-a141-e16e81203bb6 tempest-ProjectReaderTests-1887482355 None] Lock "cinder-f99855eb-f5f2-4f0e-afbf-427de055220b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:58:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d27f0334-c3ec-4c38-a141-e16e81203bb6 tempest-ProjectReaderTests-1887482355 None] Acquiring lock "cinder-quobyte-f99855eb-f5f2-4f0e-afbf-427de055220b" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:58:01 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d27f0334-c3ec-4c38-a141-e16e81203bb6 tempest-ProjectReaderTests-1887482355 None] Lock "cinder-quobyte-f99855eb-f5f2-4f0e-afbf-427de055220b" acquired by "delete_volume" :: waited 0.013s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:58:01 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85afa7a-2c3e-45fa-af0b-a137ad40bbde]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:58:01 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d27f0334-c3ec-4c38-a141-e16e81203bb6 tempest-ProjectReaderTests-1887482355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f99855eb-f5f2-4f0e-afbf-427de055220b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:58:02 devstack sudo[108608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f99855eb-f5f2-4f0e-afbf-427de055220b Jul 08 14:58:02 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:58:02 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root Jul 08 14:58:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d27f0334-c3ec-4c38-a141-e16e81203bb6 tempest-ProjectReaderTests-1887482355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f99855eb-f5f2-4f0e-afbf-427de055220b" returned: 0 in 0.717s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:58:02 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d27f0334-c3ec-4c38-a141-e16e81203bb6 tempest-ProjectReaderTests-1887482355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f99855eb-f5f2-4f0e-afbf-427de055220b {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:58:02 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f99855eb-f5f2-4f0e-afbf-427de055220b Jul 08 14:58:02 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:58:03 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Jul 08 14:58:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d27f0334-c3ec-4c38-a141-e16e81203bb6 tempest-ProjectReaderTests-1887482355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-f99855eb-f5f2-4f0e-afbf-427de055220b" returned: 0 in 0.600s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:58:03 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d27f0334-c3ec-4c38-a141-e16e81203bb6 tempest-ProjectReaderTests-1887482355 None] Lock "cinder-quobyte-f99855eb-f5f2-4f0e-afbf-427de055220b" released by "delete_volume" :: held 1.352s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:58:03 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-d27f0334-c3ec-4c38-a141-e16e81203bb6 tempest-ProjectReaderTests-1887482355 None] Created reservations ['be119527-f6e0-4512-a30d-4e510ee5aecc', 'a50992a4-7b6f-40bf-9245-bcd9a85b39d9', '83fbdfad-0678-44ac-9021-3d153ae491a4', '92a61bbd-b403-4db8-9ec7-d5dce70c1e9d'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:58:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d27f0334-c3ec-4c38-a141-e16e81203bb6 tempest-ProjectReaderTests-1887482355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:58:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d27f0334-c3ec-4c38-a141-e16e81203bb6 tempest-ProjectReaderTests-1887482355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:58:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d27f0334-c3ec-4c38-a141-e16e81203bb6 tempest-ProjectReaderTests-1887482355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:58:03 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-d27f0334-c3ec-4c38-a141-e16e81203bb6 tempest-ProjectReaderTests-1887482355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:58:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-d27f0334-c3ec-4c38-a141-e16e81203bb6 tempest-ProjectReaderTests-1887482355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:58:03 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d27f0334-c3ec-4c38-a141-e16e81203bb6 tempest-ProjectReaderTests-1887482355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:58:03 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:58:03 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:58:04 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-d27f0334-c3ec-4c38-a141-e16e81203bb6 tempest-ProjectReaderTests-1887482355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.603s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-d27f0334-c3ec-4c38-a141-e16e81203bb6 tempest-ProjectReaderTests-1887482355 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:58:04 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-d27f0334-c3ec-4c38-a141-e16e81203bb6 tempest-ProjectReaderTests-1887482355 None] Deleted volume successfully. Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-d27f0334-c3ec-4c38-a141-e16e81203bb6 tempest-ProjectReaderTests-1887482355 None] Lock "cinder-f99855eb-f5f2-4f0e-afbf-427de055220b-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Flow 'volume_create_manager' (a26b8608-c8d9-4e51-b6ea-0b3f3995fd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f15dbea-07ad-4dd3-8476-f3a3de60db03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f15dbea-07ad-4dd3-8476-f3a3de60db03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1809517498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d686b295b31a491f823fdab32e6127e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:58:04Z,use_quota=True,user_id='89a9d0de6c634441b8762fbe7b74d1e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683660c4-b590-41bd-a304-a4ae54467df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683660c4-b590-41bd-a304-a4ae54467df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f292eed-e83a-4dc7-9c14-9843eae75ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f292eed-e83a-4dc7-9c14-9843eae75ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef', 'volume_name': 'volume-e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d041dc8-8430-4687-8cca-d5c8519adf61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d041dc8-8430-4687-8cca-d5c8519adf61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d11d9d-8250-440f-81f7-85327df8c30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:58:04 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Volume e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef', 'volume_size': 1} Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1809517498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d686b295b31a491f823fdab32e6127e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:58:04Z,use_quota=True,user_id='89a9d0de6c634441b8762fbe7b74d1e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Creating volume e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:58:04 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:58:04 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:58:04 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef 1073741824 Jul 08 14:58:04 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:58:05 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Jul 08 14:58:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef 1073741824" returned: 0 in 0.779s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:58:05 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:58:05 devstack sudo[108625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef Jul 08 14:58:05 devstack sudo[108625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:58:06 devstack sudo[108625]: pam_unix(sudo:session): session closed for user root Jul 08 14:58:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef" returned: 0 in 0.624s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:58:06 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:58:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:58:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56d11d9d-8250-440f-81f7-85327df8c30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:58:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f203ed4-af6d-4c5d-990f-1cf03a33de5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:58:06 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Volume volume-e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef (e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef): created successfully Jul 08 14:58:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f203ed4-af6d-4c5d-990f-1cf03a33de5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:58:06 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Flow 'volume_create_manager' (a26b8608-c8d9-4e51-b6ea-0b3f3995fd6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:58:06 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-aab251ad-ab73-4106-9ebb-f982f013afae tempest-ProjectReaderTests-1887482355 None] Created volume successfully. Jul 08 14:58:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76a99510-a2ef-4abd-b141-642de94ebcbd tempest-ProjectReaderTests-1887482355 None] Acquiring lock "cinder-e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:58:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76a99510-a2ef-4abd-b141-642de94ebcbd tempest-ProjectReaderTests-1887482355 None] Lock "cinder-e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:58:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76a99510-a2ef-4abd-b141-642de94ebcbd tempest-ProjectReaderTests-1887482355 None] Acquiring lock "cinder-quobyte-e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:58:06 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76a99510-a2ef-4abd-b141-642de94ebcbd tempest-ProjectReaderTests-1887482355 None] Lock "cinder-quobyte-e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef" acquired by "delete_volume" :: waited 0.013s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:58:06 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa905346-65e2-455a-b7b6-830b51071f2d]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:58:06 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76a99510-a2ef-4abd-b141-642de94ebcbd tempest-ProjectReaderTests-1887482355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:58:06 devstack sudo[108628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef Jul 08 14:58:06 devstack sudo[108628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:58:07 devstack sudo[108628]: pam_unix(sudo:session): session closed for user root Jul 08 14:58:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76a99510-a2ef-4abd-b141-642de94ebcbd tempest-ProjectReaderTests-1887482355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef" returned: 0 in 0.721s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:58:07 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76a99510-a2ef-4abd-b141-642de94ebcbd tempest-ProjectReaderTests-1887482355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:58:07 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef Jul 08 14:58:07 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:58:08 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Jul 08 14:58:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76a99510-a2ef-4abd-b141-642de94ebcbd tempest-ProjectReaderTests-1887482355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef" returned: 0 in 0.612s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:58:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76a99510-a2ef-4abd-b141-642de94ebcbd tempest-ProjectReaderTests-1887482355 None] Lock "cinder-quobyte-e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef" released by "delete_volume" :: held 1.367s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:58:08 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-76a99510-a2ef-4abd-b141-642de94ebcbd tempest-ProjectReaderTests-1887482355 None] Created reservations ['ff3461b7-7353-4ef6-8e7b-29dad7733957', 'c85df739-7768-4ae8-b817-6e86b2b02112', 'a18f0b7d-d17b-4657-8e9a-dcd4d49a61e9', '5dce2253-0f40-4a0f-8fe6-ddaab297bc85'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:58:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-76a99510-a2ef-4abd-b141-642de94ebcbd tempest-ProjectReaderTests-1887482355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:58:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-76a99510-a2ef-4abd-b141-642de94ebcbd tempest-ProjectReaderTests-1887482355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:58:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-76a99510-a2ef-4abd-b141-642de94ebcbd tempest-ProjectReaderTests-1887482355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:58:08 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-76a99510-a2ef-4abd-b141-642de94ebcbd tempest-ProjectReaderTests-1887482355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:58:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-76a99510-a2ef-4abd-b141-642de94ebcbd tempest-ProjectReaderTests-1887482355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:58:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76a99510-a2ef-4abd-b141-642de94ebcbd tempest-ProjectReaderTests-1887482355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:58:08 devstack sudo[108636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:58:08 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:58:08 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root Jul 08 14:58:08 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-76a99510-a2ef-4abd-b141-642de94ebcbd tempest-ProjectReaderTests-1887482355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.607s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:58:08 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-76a99510-a2ef-4abd-b141-642de94ebcbd tempest-ProjectReaderTests-1887482355 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:58:08 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-76a99510-a2ef-4abd-b141-642de94ebcbd tempest-ProjectReaderTests-1887482355 None] Deleted volume successfully. Jul 08 14:58:08 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-76a99510-a2ef-4abd-b141-642de94ebcbd tempest-ProjectReaderTests-1887482355 None] Lock "cinder-e43ad6f5-ecb2-4bb1-99df-34f9fc3ad5ef-delete_volume" released by "delete_volume" :: held 2.154s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:58:09 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:58:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Flow 'volume_create_manager' (ac997a88-0b07-4e6e-bc2a-47c766dc011c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:58:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4cd6ef-e9e8-4be4-8f33-06ea938caa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:58:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4cd6ef-e9e8-4be4-8f33-06ea938caa79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-530986200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042d2b94-fe33-4b2c-9a34-6518e9e6e481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d686b295b31a491f823fdab32e6127e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:58:09Z,use_quota=True,user_id='89a9d0de6c634441b8762fbe7b74d1e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:58:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d2d3bf4-cd10-4376-8aac-1fb9368efa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:58:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d2d3bf4-cd10-4376-8aac-1fb9368efa16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:58:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cf3469-e654-4ab6-ae6f-2e81bfc0c0aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:58:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20cf3469-e654-4ab6-ae6f-2e81bfc0c0aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '042d2b94-fe33-4b2c-9a34-6518e9e6e481', 'volume_name': 'volume-042d2b94-fe33-4b2c-9a34-6518e9e6e481', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:58:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aac9968-0515-4358-8e26-1b686c9343c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:58:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aac9968-0515-4358-8e26-1b686c9343c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:58:09 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22575a9-6f0a-4b32-bd47-7790014222d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:58:09 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Volume 042d2b94-fe33-4b2c-9a34-6518e9e6e481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-042d2b94-fe33-4b2c-9a34-6518e9e6e481', 'volume_size': 1} Jul 08 14:58:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:58:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:58:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-530986200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042d2b94-fe33-4b2c-9a34-6518e9e6e481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d686b295b31a491f823fdab32e6127e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:58:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:58:09Z,use_quota=True,user_id='89a9d0de6c634441b8762fbe7b74d1e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:58:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Creating volume 042d2b94-fe33-4b2c-9a34-6518e9e6e481 {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:58:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:58:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:58:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:58:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:58:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:58:09 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:58:09 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:58:09 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042d2b94-fe33-4b2c-9a34-6518e9e6e481 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:58:09 devstack sudo[108639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042d2b94-fe33-4b2c-9a34-6518e9e6e481 1073741824 Jul 08 14:58:09 devstack sudo[108639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:58:10 devstack sudo[108639]: pam_unix(sudo:session): session closed for user root Jul 08 14:58:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042d2b94-fe33-4b2c-9a34-6518e9e6e481 1073741824" returned: 0 in 0.749s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:58:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042d2b94-fe33-4b2c-9a34-6518e9e6e481 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:58:10 devstack sudo[108644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042d2b94-fe33-4b2c-9a34-6518e9e6e481 Jul 08 14:58:10 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:58:10 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root Jul 08 14:58:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042d2b94-fe33-4b2c-9a34-6518e9e6e481" returned: 0 in 0.624s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:58:10 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:58:10 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.412s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:58:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22575a9-6f0a-4b32-bd47-7790014222d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-042d2b94-fe33-4b2c-9a34-6518e9e6e481', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:58:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62503414-107e-471d-810f-78071edc90b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:58:10 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Volume volume-042d2b94-fe33-4b2c-9a34-6518e9e6e481 (042d2b94-fe33-4b2c-9a34-6518e9e6e481): created successfully Jul 08 14:58:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62503414-107e-471d-810f-78071edc90b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:58:10 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Flow 'volume_create_manager' (ac997a88-0b07-4e6e-bc2a-47c766dc011c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:58:10 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-17f0f5d1-cb1f-48b9-9892-b8caff288237 tempest-ProjectReaderTests-1887482355 None] Created volume successfully. Jul 08 14:58:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5e47ad17-fb37-4fd9-9e90-478e16973313 tempest-ProjectReaderTests-1887482355 None] Acquiring lock "cinder-042d2b94-fe33-4b2c-9a34-6518e9e6e481-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:58:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5e47ad17-fb37-4fd9-9e90-478e16973313 tempest-ProjectReaderTests-1887482355 None] Lock "cinder-042d2b94-fe33-4b2c-9a34-6518e9e6e481-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:58:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5e47ad17-fb37-4fd9-9e90-478e16973313 tempest-ProjectReaderTests-1887482355 None] Acquiring lock "cinder-quobyte-042d2b94-fe33-4b2c-9a34-6518e9e6e481" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:58:11 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5e47ad17-fb37-4fd9-9e90-478e16973313 tempest-ProjectReaderTests-1887482355 None] Lock "cinder-quobyte-042d2b94-fe33-4b2c-9a34-6518e9e6e481" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:58:11 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f411c4b-049a-47d4-a01b-0e4faaf3dadf]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:58:11 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e47ad17-fb37-4fd9-9e90-478e16973313 tempest-ProjectReaderTests-1887482355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042d2b94-fe33-4b2c-9a34-6518e9e6e481 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:58:11 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042d2b94-fe33-4b2c-9a34-6518e9e6e481 Jul 08 14:58:11 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:58:12 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Jul 08 14:58:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e47ad17-fb37-4fd9-9e90-478e16973313 tempest-ProjectReaderTests-1887482355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042d2b94-fe33-4b2c-9a34-6518e9e6e481" returned: 0 in 0.733s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:58:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e47ad17-fb37-4fd9-9e90-478e16973313 tempest-ProjectReaderTests-1887482355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042d2b94-fe33-4b2c-9a34-6518e9e6e481 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:58:12 devstack sudo[108654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042d2b94-fe33-4b2c-9a34-6518e9e6e481 Jul 08 14:58:12 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:58:12 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root Jul 08 14:58:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e47ad17-fb37-4fd9-9e90-478e16973313 tempest-ProjectReaderTests-1887482355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-042d2b94-fe33-4b2c-9a34-6518e9e6e481" returned: 0 in 0.633s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:58:12 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5e47ad17-fb37-4fd9-9e90-478e16973313 tempest-ProjectReaderTests-1887482355 None] Lock "cinder-quobyte-042d2b94-fe33-4b2c-9a34-6518e9e6e481" released by "delete_volume" :: held 1.405s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:58:12 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-5e47ad17-fb37-4fd9-9e90-478e16973313 tempest-ProjectReaderTests-1887482355 None] Created reservations ['84bf37a7-71d4-47be-b42e-90a70e52dc3e', '81580fa8-f1b1-4664-a54d-5317912072c1', '13f7555b-9331-4b9f-af5d-59b824dcfb6f', 'e896d26c-fa5f-47e3-915d-cd62954e3922'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:58:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5e47ad17-fb37-4fd9-9e90-478e16973313 tempest-ProjectReaderTests-1887482355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:58:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5e47ad17-fb37-4fd9-9e90-478e16973313 tempest-ProjectReaderTests-1887482355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:58:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5e47ad17-fb37-4fd9-9e90-478e16973313 tempest-ProjectReaderTests-1887482355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:58:12 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-5e47ad17-fb37-4fd9-9e90-478e16973313 tempest-ProjectReaderTests-1887482355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:58:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-5e47ad17-fb37-4fd9-9e90-478e16973313 tempest-ProjectReaderTests-1887482355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:58:12 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e47ad17-fb37-4fd9-9e90-478e16973313 tempest-ProjectReaderTests-1887482355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:58:12 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:58:12 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:58:13 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Jul 08 14:58:13 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-5e47ad17-fb37-4fd9-9e90-478e16973313 tempest-ProjectReaderTests-1887482355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.643s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:58:13 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-5e47ad17-fb37-4fd9-9e90-478e16973313 tempest-ProjectReaderTests-1887482355 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:58:13 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-5e47ad17-fb37-4fd9-9e90-478e16973313 tempest-ProjectReaderTests-1887482355 None] Deleted volume successfully. Jul 08 14:58:13 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-5e47ad17-fb37-4fd9-9e90-478e16973313 tempest-ProjectReaderTests-1887482355 None] Lock "cinder-042d2b94-fe33-4b2c-9a34-6518e9e6e481-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:58:13 devstack cinder-volume[87240]: DEBUG cinder.volume.flows.manager.create_volume [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87240) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 14:58:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Flow 'volume_create_manager' (7f2bec6e-58c8-4482-b504-a27d988fca9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:58:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a29c4d58-fb20-4a8a-917a-73ca14f986b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:58:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a29c4d58-fb20-4a8a-917a-73ca14f986b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-860874252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d97879-185c-41e0-92e5-340df9910aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d686b295b31a491f823fdab32e6127e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:58:14Z,use_quota=True,user_id='89a9d0de6c634441b8762fbe7b74d1e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:58:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905920ca-eb5a-483a-adef-52e5eefdf55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:58:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (905920ca-eb5a-483a-adef-52e5eefdf55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:58:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3b9f0e-1c6c-48ff-b687-eeb933566ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:58:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce3b9f0e-1c6c-48ff-b687-eeb933566ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31d97879-185c-41e0-92e5-340df9910aaf', 'volume_name': 'volume-31d97879-185c-41e0-92e5-340df9910aaf', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:58:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46982133-690c-40d7-acbb-3b3694ba1a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:58:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46982133-690c-40d7-acbb-3b3694ba1a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:58:14 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20ab6b8-0e94-47d8-9221-c59fca04a748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:58:14 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Volume 31d97879-185c-41e0-92e5-340df9910aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31d97879-185c-41e0-92e5-340df9910aaf', 'volume_size': 1} Jul 08 14:58:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:58:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:58:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-08T12:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-860874252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d97879-185c-41e0-92e5-340df9910aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d686b295b31a491f823fdab32e6127e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-08T12:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-08T12:58:14Z,use_quota=True,user_id='89a9d0de6c634441b8762fbe7b74d1e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0aa8b1ef-f09a-45a1-91ca-53857a1b94cb),volume_type_id=0aa8b1ef-f09a-45a1-91ca-53857a1b94cb)}" {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 14:58:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.remotefs [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Creating volume 31d97879-185c-41e0-92e5-340df9910aaf {{(pid=87240) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 14:58:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:58:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:58:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:58:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:58:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:58:14 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Selected osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad as target Quobyte volume. {{(pid=87240) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 14:58:14 devstack cinder-volume[87240]: INFO cinder.volume.drivers.remotefs [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] casted to osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad Jul 08 14:58:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-31d97879-185c-41e0-92e5-340df9910aaf 1073741824 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:58:14 devstack sudo[108660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-31d97879-185c-41e0-92e5-340df9910aaf 1073741824 Jul 08 14:58:14 devstack sudo[108660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:58:14 devstack sudo[108660]: pam_unix(sudo:session): session closed for user root Jul 08 14:58:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-31d97879-185c-41e0-92e5-340df9910aaf 1073741824" returned: 0 in 0.774s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:58:14 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-31d97879-185c-41e0-92e5-340df9910aaf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:58:14 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-31d97879-185c-41e0-92e5-340df9910aaf Jul 08 14:58:14 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:58:15 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Jul 08 14:58:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-31d97879-185c-41e0-92e5-340df9910aaf" returned: 0 in 0.609s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:58:15 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'} {{(pid=87240) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 14:58:15 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:58:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20ab6b8-0e94-47d8-9221-c59fca04a748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31d97879-185c-41e0-92e5-340df9910aaf', 'volume_size': 1}' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:58:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6cc1402-0904-45e1-95b1-42d8ae782522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 14:58:15 devstack cinder-volume[87240]: INFO cinder.volume.flows.manager.create_volume [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Volume volume-31d97879-185c-41e0-92e5-340df9910aaf (31d97879-185c-41e0-92e5-340df9910aaf): created successfully Jul 08 14:58:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6cc1402-0904-45e1-95b1-42d8ae782522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87240) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 14:58:15 devstack cinder-volume[87240]: DEBUG cinder.volume.manager [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Flow 'volume_create_manager' (7f2bec6e-58c8-4482-b504-a27d988fca9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87240) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 14:58:15 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-530674b6-935e-4fcc-a37a-981cdb52c088 tempest-ProjectReaderTests-1887482355 None] Created volume successfully. Jul 08 14:58:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ae258965-6665-4771-b66c-f0b020a23c09 tempest-ProjectReaderTests-1887482355 None] Acquiring lock "cinder-31d97879-185c-41e0-92e5-340df9910aaf-delete_volume" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:58:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ae258965-6665-4771-b66c-f0b020a23c09 tempest-ProjectReaderTests-1887482355 None] Lock "cinder-31d97879-185c-41e0-92e5-340df9910aaf-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:58:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ae258965-6665-4771-b66c-f0b020a23c09 tempest-ProjectReaderTests-1887482355 None] Acquiring lock "cinder-quobyte-31d97879-185c-41e0-92e5-340df9910aaf" by "delete_volume" {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 14:58:16 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ae258965-6665-4771-b66c-f0b020a23c09 tempest-ProjectReaderTests-1887482355 None] Lock "cinder-quobyte-31d97879-185c-41e0-92e5-340df9910aaf" acquired by "delete_volume" :: waited 0.011s {{(pid=87240) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 14:58:16 devstack cinder-volume[87240]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae9a7b5-2f3f-4107-a3a6-574a9a716481]: (4, 'qcow2') {{(pid=88506) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 14:58:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae258965-6665-4771-b66c-f0b020a23c09 tempest-ProjectReaderTests-1887482355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-31d97879-185c-41e0-92e5-340df9910aaf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:58:16 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-31d97879-185c-41e0-92e5-340df9910aaf Jul 08 14:58:16 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:58:16 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Jul 08 14:58:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae258965-6665-4771-b66c-f0b020a23c09 tempest-ProjectReaderTests-1887482355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-31d97879-185c-41e0-92e5-340df9910aaf" returned: 0 in 0.710s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:58:16 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae258965-6665-4771-b66c-f0b020a23c09 tempest-ProjectReaderTests-1887482355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-31d97879-185c-41e0-92e5-340df9910aaf {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:58:16 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-31d97879-185c-41e0-92e5-340df9910aaf Jul 08 14:58:16 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:58:17 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Jul 08 14:58:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae258965-6665-4771-b66c-f0b020a23c09 tempest-ProjectReaderTests-1887482355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49/volume-31d97879-185c-41e0-92e5-340df9910aaf" returned: 0 in 0.609s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:58:17 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ae258965-6665-4771-b66c-f0b020a23c09 tempest-ProjectReaderTests-1887482355 None] Lock "cinder-quobyte-31d97879-185c-41e0-92e5-340df9910aaf" released by "delete_volume" :: held 1.358s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:58:17 devstack cinder-volume[87240]: DEBUG cinder.quota [None req-ae258965-6665-4771-b66c-f0b020a23c09 tempest-ProjectReaderTests-1887482355 None] Created reservations ['84009c25-56e3-4b9f-bf77-39976427ae89', '445d1fe6-a8fa-4d10-8f83-d40c0e2d590c', 'd4615dcf-9184-4c92-a78d-1be3cdeb336f', '7c213a64-23be-45e8-a789-94d58a4bddaf'] {{(pid=87240) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 14:58:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ae258965-6665-4771-b66c-f0b020a23c09 tempest-ProjectReaderTests-1887482355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 14:58:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ae258965-6665-4771-b66c-f0b020a23c09 tempest-ProjectReaderTests-1887482355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 14:58:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ae258965-6665-4771-b66c-f0b020a23c09 tempest-ProjectReaderTests-1887482355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad': None} {{(pid=87240) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 14:58:17 devstack cinder-volume[87240]: DEBUG cinder.volume.drivers.quobyte [None req-ae258965-6665-4771-b66c-f0b020a23c09 tempest-ProjectReaderTests-1887482355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-dc700279-fe91-4d0f-9772-0b50bca36fad'] {{(pid=87240) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 14:58:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.lockutils [None req-ae258965-6665-4771-b66c-f0b020a23c09 tempest-ProjectReaderTests-1887482355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87240) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 14:58:17 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae258965-6665-4771-b66c-f0b020a23c09 tempest-ProjectReaderTests-1887482355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 14:58:17 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49 Jul 08 14:58:17 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 14:58:18 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Jul 08 14:58:18 devstack cinder-volume[87240]: DEBUG oslo_concurrency.processutils [None req-ae258965-6665-4771-b66c-f0b020a23c09 tempest-ProjectReaderTests-1887482355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b29f4412c40e553188630e46df2fdf49" returned: 0 in 0.602s {{(pid=87240) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 14:58:18 devstack cinder-volume[87240]: DEBUG cinder.manager [None req-ae258965-6665-4771-b66c-f0b020a23c09 tempest-ProjectReaderTests-1887482355 None] Notifying Schedulers of capabilities ... {{(pid=87240) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 14:58:18 devstack cinder-volume[87240]: INFO cinder.volume.manager [None req-ae258965-6665-4771-b66c-f0b020a23c09 tempest-ProjectReaderTests-1887482355 None] Deleted volume successfully. Jul 08 14:58:18 devstack cinder-volume[87240]: DEBUG cinder.coordination [None req-ae258965-6665-4771-b66c-f0b020a23c09 tempest-ProjectReaderTests-1887482355 None] Lock "cinder-31d97879-185c-41e0-92e5-340df9910aaf-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=87240) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 14:58:27 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:SELECT=24,cinder:UPDATE=50,cinder:DELETE=4,cinder:INSERT=11 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 14:58:28 devstack cinder-volume[87240]: DEBUG dbcounter [-] [87240] Writing DB stats cinder:UPDATE=38,cinder:SELECT=32,cinder:INSERT=9,cinder:DELETE=4 {{(pid=87240) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}